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INTRODUCTION 


Spitz has recently stated that “the 
list of projective techniques grows 
longer daily.” While this may be con- 
sidered psychological, if not poetic, license, 
there is nonetheless some truth to the 
remark. One has only to look, for in- 
stance, at the long bibliography in Frank’s 
Projective Methods to realize the 
numerous additions in this field since 
Frank himself coined the term in 1938 to 
describe the Rorschach test and the The- 
matic Apperception Test. What justi- 
fication is there in further adding to this 
ever-growing list ? This must be the ques- 
tion which any experimenter asks himself 
before devising and advocating yet an- 
other projective method. 

For introducing to others a test which 
has proved of value to this writer over a 
two-year period, the reasons are as fol- 
lows: the test is extraordinarily quick 
and simple to administer; it can be han- 
dled and administered to large groups as 
easily as to a single individual ; there is no 
scoring; classification can be instanta- 
neous; yet, like the handling of the 
Man-Woman Drawing, as described by 
Machover“), a wealth of information can 
be gained in a short time. This test has 
proved of diagnostic value in many cases, 
and it has proved useful in other cases for 
quickly eliciting the core or focus of the 
psychological disturbance. With all other 
drawing techniques, it belongs to that class 
of material which can be transmitted in 
the original and in its entirety to the 


therapist, so that he can have the actual 
data, over and above the psychologist’s 
comments and evaluation. In this connec- 
tion we have made a point of taking car- 
bon copies of all drawings in our testing 
interview and relating our evaluative 
comments to these illustrations. Finally, 
such material can be used with the patient 
as an objective point of departure in ther- 
apy and can be used for comparative pur- 
poses at various stages.’ 


MATERIALS 


This short paper deals with the accumu- 
lated experience gained from the study of 
500 cases on whom psychiatric opinion 
was available and to whom a full battery 
of already established psychological tech- 
niques was also administered. Each of 
the 500 patients studied received the 
Wechsler-Bellevue, the Rorschach Test, 
the Man-Woman Drawings, the Szondi 
Test, and in many cases independent 
evaluation of handwriting by an expert 
graphologist. A more detailed publica- 
tion, with numerous graphic examples, 
will be forthcoming.” In this instance our 
aim is to make the technique and proce- 
dure available to others immediately and 
to make suggestions in view of our pres- 
ent findings. 


Subjects. The 500 individuals whose 
drawings comprise the subject matter for 


1. The present writer has used this test in- 
tensively in therapeutic interviews with a few 
cases. Its use with many patients of various 
kinds has been demonstrated by Dr. William 
Caveness at the Boston Psychopathic Hospital. 
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this study may be described as follows: 
individuals who are experiencing psycho- 
logical difficulties and who are seeking 
psychiatric assistance in their handling of 
them. In contrast to this, the hundred 
individuals who comprise our control 
group were persons without overt psycho- 
logical symptoms. We wish to make it 
clear, however, that we are refraining 
from presenting statistics on the differ- 
ences between “normals” and_ patients. 
This is a deliberate omission to focus 
attention on an unsatisfactory state of af- 
fairs in experimental clinical procedure. 
Who are “normals” and who should con- 
stitute “control subjects?” In experi- 
mental psychology, the psychology of the 
laboratory and of the academic world, the 
experimenter can readily divide rats 
which are to run mazes or persons who 
are to learn under different conditions into 
“equated groups,” and sit back comfort- 
ably in the knowledge of satisfactory sci- 
entific procedure—exposing one group to 
certain controlled variables to which he 
does not submit the others. There is a 
grave danger, however, that, in order to 
find “controls” for experimental clinical 
projects, the too academically trained psy- 
chologist will consider all those not in his 
particular clinic or hospital or not referred 
to him for examination as “normal per- 
sons” or persons without psychological 
difficulties. 

There are many pitfalls and fallacies in- 
volved here, however. If one takes as 
“controls” an unselected group of indi- 
viduals and contrasts them with the par- 
ticular patient group under study, one 
may well find, on more exhaustive scru- 
tiny, that among the “controls” are per- 
sons who also have sought or are seeking 
expert psychiatric aid elsewhere. There 
are individuals who have successfully com- 
pleted or are undergoing an analysis. 
Into which group do these persons fall? 
Do they then cease to be “normals?” Are 
they to be classified as “normals” when 
they take the test under some conditions 
and “abnormals” when they take it under 
others? It is not necessary to belabor the 
point, provided that a warning and ex- 
planation are conveyed. And while cer- 
tain differences between our especially re- 
ferred group and our random sample 
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group exist, the test is not advocated for 
screening the normal from the abnormal, 
the adjusted from the maladjusted, but 
rather to highlight the type and extent of 
a given psychological problem and _ its 
manner of expressing itself, this latter 
providing a clue to other, inter-related 
psychological processes in all persons. 


Instructions for Administration. To the 
individuals to whom this test was given, 
the instructions were always as follows: 
“What is the Most Unpleasant Thing that 
you can think of?” or, alternatively, “I 
want you to think of the Most Unpleasant 
Thing that you can imagine.” Then, after 
a slight pause, the examiner continues, 
“And now I want you to draw it for me,” 
and at this point he hands the subject a 
drawing pad and a pencil. He then adds 
the further instructions, “You can draw 
it in actuality, schematically, or symbol- 
ically, whichever you please.”” When the 
subject returns his drawing, he is asked to 
describe it and to give free associations 
to it. 

The paper used in all cases was stand- 
ard 8% inch by 11 inch. A carbon under- 
neath provided a second copy and also gave 
interesting clues as to pressure, erasing, 
and shading. Originally we also asked 
for a drawing of the Most Pleasant Con- 
cept, but found in this instance much more 
trivial, banal, and stereotyped expressions 
which rarely, if ever, provided important 
information. 


RESULTS 


Reactions of the Subject to the Test In- 
structions. We may estimate the subject’s 
readiness to respond on a six point scale. 


1. The subject immediately takes the 
pencil, looks at the examiner in a 
somewhat accusing or penetrating 
fashion, and promptly draws some 
idea, concept, or object, as if, by 
the question, the examiner had 
triggered a response which was 
waiting for the word “go.” This 
over-speedy reaction is frequently 
accompanied by a spoken or ges- 
tured question on the part of the 
patient, “How did you know I had 
this unpleasant thought?” The 
graphic products of persons who 
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respond in this way are frequently 
of a symbolic type, epitomizing a 
state of mind or psychological expe- 
rience. (See Figures 4, 5, and 6.) 

Type 2 may be considered the “aver- 
age-speedy” type in the sense that 
the subject ponders for a few sec- 
onds, as though surveying a series 


of possible alternative answers, then : 


without ado or conflict, he records 
his decision, sometimes with some 
slight apologetic comment that, al- 
though he cannot draw well, it will 
be seen what it is that he is attempt- 
ing. This type of reaction corre- 
lates highly with what have been 
determined as “popular” answers in 
this test. (See Figure 1.) 

The third type of response may be 
called the “average-slow.” This is 
similar to Type 2 except that the 
subject is more hesitant in making 
his decision; he puts up a greater 


barrage of defense in terms of his * 


inability to draw satisfactorily. Fre- 
quently the lines of the drawings 
are tentative here. The subject 
requires reassurance in order to con- 
tinue. 

Reaction Type 4 may be described 
as slow and disturbed. Here the 
subject knows what specific and 
personally oriented experience he 
wishes to portray, but finds its por- 
trayal so disturbing that he cannot 
bring himself to commit it to paper. 
Repeated reassurances are neces- 
sary, and much encouragement is 
useful. 

This type of delay reaches its ex- 
treme at a point where there is re- 
fusal to commit the highly disturb- 
ing idea to paper. Of our series of 
500 cases we found several persons 
who were unable to complete or con- 
tinue the test despite all help and 
pressure. In one instance a mo- 
ment of panic-like anxiety was 
evoked. Concerning the nature of 
this, an interesting account was 
given the following day by the pa- 
tient to his therapist. 

Reaction Type 6 is failure, but of 
a different order. The individual 
here literally “cannot think of any- 


izations are in order. 
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thing unpleasant,” and despite en- 
couragement and finally such sug- 
gestive questions as, “Are there 
really no unpleasant things in the 
world? cannot bring himself to enter 
into the test situation. 


No statistics are available at this writ- 
ing on the distribution of our 500 sub- 
jects, since these various types of reac- 
tions emerged slowly in the experiment- 
er’s mind in the course of the work with 
the test. However, one or two general- 
The more normal, 
or let us say the performance of persons 
who are less seriously disturbed (when 
correlated with other test findings and 
psychiatric evaluation ), correlate with Re- 
actions 2 and 3. A certain amount of hesi- 
tation, a laughing comment on inability to 
draw with, nonetheless, a courageous at- 
tempt to conform to the test instructions, 
would seem to equate with a minimum of 
psychological disturbance at the time of 
the testing. This is also brought out in 
the study of random groups in which this 
is unquestionably the prevailing reaction. 

On the other hand, instantaneous por- 
trayal of an idea which seems to have been 
waiting for expression, extreme reluctance 
to portray an idea because it is too disturb- 
ing, the inability to find anything unpleas- 
ant in the world—these have correlated 
with more seriously disturbed individuals 
when, again, they have been appraised by 
the total test battery or by psychiatric 
evaluation. 


Content: The Subject Matter of the Most 
Unpleasant Concept. What does the sub- 


ject draw in this test situation? Do we 
find 500 different ideas of unpleasant- 
ness? By no means. Are there types 
of answers which can be considered as 
“popular,” psychologically neutral, relat- 
ing to an unbiased and somewhat objective 
appraisal of the unpleasant? It would 
seem so. We have attempted to bring an 
initial state of order to our findings by 
introducing five major divisions or classi- 
fications of our material, with various sub- 
divisions. We will deal first with a dis- 
cussion of the major groupings and then 
consider the subheadings in detail. As a 
starting point, the following diagram may 
be considered as showing graphically the 
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RELATING TO SEX 


THE UNPLEASANT WITHIN 


Symbolic States of Mind, 

Loneliness, Pent-up Feel- 
ings, Phobias, Bizarre 
Fantasies, Dreams 


DEATH PAIN 


The Atomic Bomb, War, 
Cruelty of Aggressor 
Nations 


ILLNESS 


| 


THE UNPLEASANT WITHOUT 
Small Animals, Fecal Matter, 
Vomit, Specific Persons, 
Loss of Objects 


Evasion Through the 
Trival, 
Displacement 
Dissociation 
Failure 


different “directions” in which the un- 
pleasant may lie. 


We may start from a neutral central 
area which is highly realistic, impersonal, 
logical, and universal. I have called this 
area: “War, the Atomic Bomb, or Cruelty 
of Aggressor Nations.” It is impossible 
to quarrel with the legitimacy of this area 
as a Most Unpleasant Concept. More- 
over, it will be noticed that in this in- 
stance the word “unpleasant” has been 
expanded to its maximum capacity to 
mean “terrifying,” “terrible,” and “ter- 
rible to many.” We have put as an outer 
ring to this neutral area those drawings 
which represent death, pain, or illness. 
While one cannot quarrel with the legiti- 
macy of the unpleasantness of a violent 
death, nonetheless this group has a little 
less of the universality of the first group 
in that the individual is concerned with his 
own death rather than the death of many, 
or he is concerned with the death of some- 
one close to him.* 

2. It should be noted that merely to consider 
these concepts as the “popular” does not mean 
that in each and every case specific and inter- 
ésting associations which may be vitally relevant 
to the psychological problem may not be elicited. 
We are using this block of associations merely 


A further look at the diagram shows 
that, on the arrow to the left, there is a 
large group of answers which may be 
considered as The Unpleasant Within. 
Here all objectivity and universality are 
lost, and the individual is concerned with 
his own particular psychological “hell.” 
I have grouped here symbolic portrayal of 
states of mind, bizarre fantasies, recurrent 
dreams, expressions of phobias, etc. 

The arrow to the right in the diagram 
points to the Unpleasant as Located Out- 
ward but now attached to some specific 
and definitely non-world-shaking event. 
Again, there are grades of legitimacy here, 
the house on fire having greater validity, 
one might say, than a small bug to harbor 
or contain human distress and misery. 
Diagrammatically represented as going in 
a different direction from the “neutral 
area,’ we have listed such examples as 
“Evasion through the Trivial, Displace- 
ment, Dissociation, and Failure.” And, 
in yet another direction, “the Unpleasant 
Located in Sex.”” Having diagrammed the 
“direction” in which the unpleasant may 
lie, a more detailed breakdown of the find- 
ings is presented in Table 1. 


as a starting point to contrast other types of 
reactions. 
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TaBLe 1. Classification of reactions on “The Most Unpleasant Concept Test” of 500 
cases undergoing psychotherapy 


Classification Remarks 


War, the atomic bomb, or cruelty as Characteristic responses of “better personality 
expressed by aggressor nations integration” as reflected in the Rorschach 
Test, lack of distortion of thought processes 
as reflected in the Similarities test of the 
Wechsler-Bellevue. In the case of the ma- 
jority, drawn somewhat crudely but  realis- 
tically ; does not correlate with the psychiatric 
evaluation of borderline psychosis. 


Death Associations here are much less neutral and uni- 
By plane versal than to the above. Among this group 
By drowning are the drawings of extremely disturbed per- 
By hanging sons, as well as those with less acute prob- 
By gashing lems. 

Death of a specific person 
Coffin as symbol 
By automobile accident 


Pain and illness Given by individuals with actual, distressing 
physical symptoms and pains (i.c. from Boeck 
sarvoid) by conversion hysterics, hypochon- 
driacal individuals. Apparently of no diag- 
nostic value. 


The Unpleasant Within 


Symbolic portrayal of a state of A highly significant and interesting group, cor- 
mind relating closely with borderline psychosis, dis- 
tortion of thought processes on the Wechsler- 
Bellevue, and bizarre concepts on the’ Ror- 

schach. Not found in the “control” group. 


Loneliness Often symbolically expressed and therefore, in 
a sense, a subgroup of the above. However, 
there is less of the bizarre quality to the 
drawings and such responses are found in per- 
sons other than borderline cases. 


Bizarre fantasies and dreams Again, some similarity with the symbolic por- 
trayal of a state of mind. Often extremely 
revealing in the uncovering of crucial ma- 
terial. Closely related to the type of free 
association which may be elicited to original 
or bizarre answers on the Rorschach Test. 


Psychological imprisonment The extraordinary uniformity of this experience 
can be seen in Figure 10, where five of the six 
cases are illustrated. 


Being awakened This rather interesting subgroup appeared in 
cases where other test material and clinical 
findings indicated withdrawal tendencies. 


Phobias Common phobias, such as fear of high places, 
fear of enclosure in a small space, ete., are 
given. We have included here, also, super- 
sensitivity as expressed in fear of disapproval 
reflected in facial expression. 


Very specific personal experiences Usually highly traumatic experiences; in three 
of six cases the incident was repressed until 
time of examination. (See Summary and 
Conclusions, Paragraph 1.) 
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1. Concluded 


Classification Remarks 


Fear of aggression. Fear of results Of particular interest is the subgroup “Aggres- 
of aggression (torture, mutila- sion toward children,” given by five women and 
tion). Aggression towards chil- relating to their own children. In one instance 
dren a fascinating slip of the pen occurred in the 

written descriptign. Subject spoke of the 
fear of killing her child which would “com- 
pletely accomplish me . .. I mean, ruin me.” 


The Unpleasant Outward 


The small animal as scapegoat Almost invariably a neurotic and frequently a 
specifically sexual problem was found to exist 
in persons who selected the animal as the 
Most Unpleasant Concept. Snakes were given 
most frequently with bugs and spiders in second 
place. In the one instance where the animal 
concept was “contaminated,” i.¢., a spider which 
had a human expression and was part human, 
the patient was known to have had several 
schizophrenic episodes. 


A house on fire (a house disordered) A house on fire bears a close relationship clin- 
ically to the diagnosis of hysteria. It was 
given exclusively by women. On the other 
hand, the two patients whose concept was a 
house disordered were borderline cases. 


Specific persons Usually the problem in this case was very close 
to the surface—intense antagonism against the 
mother or mother-in-law was expressed in 
this way. One depressed individual showed 
herself as the specific person. A deteriorated 
organic case drew Hitler. 


Fecal matter and vomit 


Loss of objects, and failure to achieve 
desired ends or objects 


The Unpleasant as Sex 


Sex Organs—The concept of homo- , Castration fears were exemplified frequently by 
sexuality drawings of individuals who had “lost limbs.” 
(See Figure 12.) Overt expressions of the 
idea of homosexuality were given in two 
cases. There was evidence of severe psycho- 

logical disturbance in both cases. 


The Unpleasant Evaded 


In the extremely trivial. In the Of particular interest are those cases which we 
weather. Through complete dis- have called “dissociation” where the individual 
sociation. Through displacement is quite unaware of why he drew what he did. 

For example, a forest, or the moon and a 
hedge, were not unpleasant to the individuals 
concerned, yet they drew them without any 
feeling that they were not complying with the 
test instructions. By “displacement” we 
mean the deliberate portrayal of an object 
which carried some of the characteristics of 
the idea the individual was afraid to portray. 
Thus, for example, the dead fish, unpleasant 
because of its smell, hid the real object, the 
mother’s menstrual pads and their smell. 


Failure 
Idea too disturbing to convey. “There 
is nothing unpleasant” 
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FIG. 2. A symbolic representation of war and the atomic bomb drawn by a person with an acute 
sexual problem. 
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FIG. 3. Drawings of snakes, bugs and octopi, showing neurotic preoccupation with the Unpleasant 
Without. Fig. 3a. Introduction of a bizarre feature in a borderline case “Rat eating a baby’s face.” 
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FIG. 4. Symbolic portrayal of a mental state repr nti ical isolation (the Unpleasant Within). 
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FIG. 5. Drawings of “soft, clutching, learing shadow” epitomizing fear to the person. 
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FIG. 6. Drawings symbolically portraying tension and confusion. 
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FIG. 7. Drawing classified as portraying a symbolic state of mind. 
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FIG. 8. Drawing interpreted by patient as “A hanized octopus with tentacles of steel and naked 


light bulbs for claws. The circles in his body seem to be subway straps, and now that | can see it again, 
the pattern of the tentacles also form a brightly-lit corridor, bare-walled and bleak.” 
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FIG. 9. This drawing was described by the subject as follows: ‘Disintegration of the personality— 
loss of selfhood. Would mean loss of vision. The head within the circle signifi i more than 
i b ion of i of ti of feeling. Limbs, helter skelter and any-which-way 
signifies destruction of purpose and direction; excentric to the circle to show exist: of t and 


contact, but indiscriminate and uncoordinated movement, and blind, unfeeling contact.’ 


f] 
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FIG. 10. Drawing representing the mono-delusion: Snake in Stomach. 
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FIG. 11. Drawing representing the phantasy ‘the eyes of God in which are reflected the burning of 
souls in hellfire.” 


FIG. 12. Drawing representing the paranoid idea of “others laughing at me and rushing my downfall.’ 
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FIG. 13. Drawings portraying the state of mind called ‘psychological imprisonment.’ Drawing C, 
reflecting early schizophrenia, represents “an ice cube in which | am imprisoned, unable to reach my 
children.” Drawing D was drawn by a man who had defrauded the government of over one million 
dollars in taxes. 
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FIG. 14. Drawings representing fears of various forms of aggression. Drawing B by ao girl terrified 
by her own homosexual desires: drawing C by a latent homosexual; drawing D by a patient rated by his 
therapist as ‘‘the most masochistic person | have ever treated,” who accepted unbelievable humiliations 
from his wife and considered the Most Unpleasant Thing to be a Woman attacking a man 
enormous index finger, possibly a phallic symbol, on the woman 


note the 
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FIG. 15. Drawings portraying unpleasant mutilation concepts related to homosexuality. Drawing A 
is an overt expression, while B and C reflect the repeated occurrence of castration fears shown by persons 
lacking an arm or leg. 


THE 


ILLUSTRATIVE MATERIAL 


The illustrations which follow have 
been selected as expressing as well as pos- 
sible the material epitomized in the above 
tables. Needless to say, it has been pos- 
sible to reproduce only a fraction of those 
which would have made the reading of 
this paper more interesting. Moreover, in 
making our reproductions as simple line 
drawings, we have lost a great deal of the 
interesting variation of shading and qual- 
ity of line. 


SUMMARY AND CONCLUSIONS 


A new five-minute projective device 
called “The Most Unpleasant Concept 
Test” is described. Based on a qualitative 
analysis of the results obtained from 500 
subjects undergoing psychotherapy, a 
tentative classification is outlined showing 
the basic types of concepts portrayed in 
this collection of drawings. It is concluded 
that this test would make a valuable addi- 
tion to a diagnostic personality appraisal 
battery for the following reasons: 

1. This procedure, when imbedded in 


a series of other projective techniques 
which are less direct, has: the interesting 


effect of shock or surprise. Frequently, 
completely forgotten experiences are re- 
covered and recorded, to the subject's 
own surprise. For example, an early 
memory of incestuous relations with a 
parent was an unexpected psychological 
discovery in the sense that it had been 
completely repressed for a long period. 
Drawing two people in bed, the individual 
suddenly stated, “Oh, that is me and my 
father!” 

2. This test allows a deeper insight to 
be gained from answers ‘given to some of 
the other projective techniques. For ex- 
ample, a subject who gave a highly un- 
usual answer to the butterfly on Card III 
of the Rorschach, namely, “two doors at 
the end of a long corridor,” made a very 
similar drawing in the Unpleasant Con- 
cept Test, but added two prison cells at 
the near ends of the corridor in which he 
and a friend were incarcerated. Associa- 
tions to this were highly revealing in 
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terms of guilt in connection with homo- 
sexual activities. 

3. The portrayal of bizarre fantasies 
seems, in some instances, to provide relief 
to the individual concerned. It 1s some- 
how a sharing of a state of mind which has 
eluded description. Now both the exam- 
iner (in his role of therapist) and the pa- 
tient can refer objectively to “my state 
of tension.” 

4. Progress in therapy is most interest- 
ingly revealed in longitudinal sections as 
the individual passes from one buried un- 
pleasant experience to another. In con- 
nection with this, the test may frequently 
foreshadow material which is subsequently 
bre mught to life. 

5. One of the advantages of this test is 
its diagnostic value. By and large, our 
point of view in regard to “diagnosis” is 
that it is the least important part of the 
contribution of the projective techniques. 
Nonetheless there are certain cases where 
an underlying schizophrenic process must 
be confirmed or ruled out before further 
treatment can be decided upon. Inclusion 
of this test in the battery has, we feel, 
strongly reinforced our objective evidence 
in such cases. We refer here to the sym- 
bolic portrayal of states of mind as rein- 
forcing the “borderline” diagnosis and, 
conversely, to the “small animal” draw- 
ings as consistent wtih the neurotic pic- 
ture. 

REFERENCES 


1. FRANK, Lawrence Proysective methods. 

(A Monograph in Ametican Lecture Series 
in’ Psychology) Ed., Molly Harrower; 
Springfield: Charles C. Thomas, 1948, 
Harrower, Motry. The unpleasant con- 
cept test. (A monograph in American Lec- 
ture Series in Psychology) Ed., Molly Har 
rower. Springfield: Charles C. Thomas 
(In preparation. ) 
Macnover, Karen. Personality projection 
in the drawing of the human figure. (A 
Monograph in American Lecture Series in 
Psychology) Ed., Molly Harrower. Spring- 
field: Charles C. Thomas, 1948. 

. Sprrz, Rene. The role of training in psy 
choanalysis in the development of research 
in clinical phychology. 7raming in Clinical 
Psychology. New York: Josiah Macy Jr. 
Foundation, 1947. 


RESEARCH IN CLINICAL PSYCHOLOGY : 1949* 
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The accurate depiction of the nature 
and extent of research activities in clinical 
psychology during the past year demands 
a reasonably thorough survey of the most 
prominent media of publication. For the 
purposes of this review the 1949 volumes 
of the following journals were examined : 
Journal of Clinical Psychology, Journal 
of Consulting Psychology, Journal of Ab- 
normal and Social Psychology, Journal of 
Applied Psychology, Journal of General 
Psychology, and Journal of Psychology. 
It is not to be expected that all reports of 
research in the clinical field are to be 
found in this limited number of journals 
but it appears that the bulk of such re- 
search is carried in these publications and, 
hence, that a study of their contents will 
vield a representative picture of research 
activities, 

The six journals carried a total of 86 
researches in clinical psychology. A. di- 
rect evaluation of this quantity is not pos- 
sible since a similar count for previous 
years is not available. However, the first 
four journals named carried 72 of the 
research papers ; this number can be com- 
pared with counts of 42, 55 and 57 ob- 
tained for the same four journals in the 
preceding three years (1946-1948) re- 
spectively."7) These figures suggest a 
definite spurt in the extent of research 
activities in the clinical field. The present 
review held to the same definition of “re- 
search” as was applied in the earlier paper, 
Le., a study “involving the systematic in- 
vestigation of a specifically described 
group of subjects and the derivation of 
normative or comparative data from psy- 
chometrics, case histories, or therapeutic 
interviews, or analysis of administration, 
scoring, and interpretation of a given in- 
strument.”” 

A brief abstract was prepared of each 
of the 86 studies as it was reviewed so 
that a later sorting could be made into the 
areas of research represented. After the 
original classification was completed, the 

* This review was prepared at the invitation 
of the editor. 


designations of a few of the categories 
were changed slightly to make them con- 
form with those used in the earlier review 
‘and thus facilitate comparisons and analy- 
sis of trends. Table 1 presents the types 


of research represented in the 86 studies 
and the number of studies of each type. 


Taste 1. Distribution of eight-six research 
studies reported in 1949, by area of 


No. of 


studies 


Percent 
of total 


Validity (projective tech- 
niques ) 

Analysis of recorded in- 
terviews 

Normative study (person- 
ality) 

Objective 
therapy 

Abbreviated tests (intelli- 
gence, 4) 

Intertest relationships... 

Validity (diagnostic pat- 
terns, W-B) 

Normative study (intelli- 
gence ) 

Ditferential diagnosis 
feebleminded 

. Normative study (struc- 

tured personality tests) 

Validity (structured per- 
sonality tests) 

Normative study (projec- 
tive techniques ) 

Validity of — psychiatric 
diagnoses 

Validity (prognostic indi- 
cators ) 

Validity of W-B 
oration index 

Test standardization 

New tests (projective).. 

New tests (intelligence ) 

Detection of malinger- 
ing 

Miscellaneous 


17.4 
9.3 


evaluation 


deteri- 


to toto ty 


The largest single category of research 
was that of validity studies of projective 
instruments, over 17 per cent of all the re- 
searches falling in this area. Consistent 
interest in the validation of projective 


y 
research represented 
Area 
2 
8 
8 9.3 
4 
5 5.8 
] 6 5 5.8 
7 
4 4.7 
j 8 
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10 
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12 
2 a0 
13 
2 2.3 
14 
2 
15 
10) 
17 
18 
2 23 
aA 7 8.2 
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techniques is indicated by the fact that 
this category ranked third in order of fre- 
quency of studies over the preceding three 
vears.“"7) Of the 15 studies in this cate- 
gory, eight were concerned with the valida- 
tion of certain principles of Rorschach 
interpretation. Of these eight studies, six 
vielded negative findings. In particular, 
the studies in this area throw serious 
doubt on the validity of the orthodox in- 
terpretations of relative responsiveness to 
the last three cards as a function of 
color“), of the level of F + percent and 
percent as discriminative of intelli- 
gence"), of color “shock”, of any of the 
Rorschach signs as predictive of academic 
success“) or of mental ability’). The 
work of Wittenborn 1% 2% in this area 
is particularly notable for the use of large 
samples, the explicit delineation of basic 
assumptions “under test, the application 
of careful statistical design, and the con- 
servative evaluation of findings. Ror- 


schachers who ho!d to the “party line” will 
reject researches such as these as atomis- 
tic and negligent of the interdependence 
of scoring variables and the configura- 


tional interpretation of records. It seems 
improbable that any kind of configura- 
tional metering of interrelated variables 
will result. in usefully valid and public 
interpretive concepts if the underlying 
variables lack any demonstrable validity. 
At any rate, it appears that the honey- 
moon of the Rorschach is over. It is not 
likely to be divorced by the ardent clini- 
cian, but it is now clearly out of the dark- 
ened ballroom and under the bright lights 
of the psychological kitchen where its 
products will be evaluated by increasingly 
critical palates. ar 

In view of the considerable doubt which 
has been cast upon the validity of rather 
basic Rorschach concepts, it is disturbing 
to find this instrument used as the sole 
criterion in the evaluation of another per- 
sonality measure?) or of a method of 
psychotherapy’??. 

Tied for second place in terms of fre- 
quency of studies is the category of 
“analysis of recorded interviews.” Like 
the validity study of projective instru- 
ments, this type of research seems to be 
receiving increasing attention. Of the 
eight studies classified in this category, 
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six were part of a unified program of 
analysis of the process of nondirective 
therapy"). A seventh study’, part of 
this same program, does not appear in 
this category because it was primarily con- 
cerned with outcome of the therapeutic 
process and was listed in the fourth cate- 
gory of Table 1. As noted above the 
primary criterion of therapeutic change 
vas the Rorschach. The only other meas- 
ure of effectiveness of therapy in this 
series of studies was a nine-step rating 
scale applied by the counselors concerned 
with each case. The major concern of the 
individual studies in this research project, 
however, was not with the validity of the 
nondirective method of achieving the ad- 
justment of maladjusted personalities but 
rather with an examination by various 
concepts, such as self-acceptance, of the 
internal mechanics of the method. One 
may seriously question the advisability of 
such concentration upon process analysis 
at a time when it has not been clearly 
established that the process is indeed 
therapeutic or within what boundaries it 
is therapeutic as judged by a reasonably 
uncontaminated criterion. Nevertheless, 
aside from the small samples (10 cases) 
used in these studies and the inadequate 
evaluative criteria, one must credit Rogers 
and his co-workers with being the only 
group having both explicitly formulated 
hypotheses concerning the therapeutic 
process and being engaged im active re- 
search pertinent to those hypotheses. 

Among the normative personality stud- 
ies (Category No. 3), Roe’s“*) report of 
her findings from the extensive psycho- 
metric and clinical study of 20 eminent 
biologists is outstanding. ‘The careful 
selection of this group of scientists for 
considerable homogeneity with respect to 
field of specialization and degree of emi- 
nence achieved and their intetisive study 
with a variety of tests vields a body of 
data which very definitely fills a gap in 
normative material on high-level, normal 
personalities measured with current in- 
struments. 

It is of interest to note that the fourth 
category of research, objective evaluation 
of therapy, contains only two studies 
which apply objective tests in measuring 
the effects of those two very popular 
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psychiatric procedures, electroshock and 
prefrontal lobotomy. Fisher’s®) study is 
of particular interest in that his subjects 
were ambulatory depressed patients who 
received electroconvulsive therapy on an 
out-patient basis. Enthusiasm for his 
finding that improvement in intellectual 
functioning occurred with improvement 
in the clinical pictures is dampened by the 
fact that none of his tests, which were 
chiefly of a verbal-intellectual type, dif- 
ferentiated between those patients who 
responded favorably to electroshock and 
those who were unchanged. Jones’? 
conclusion that over 50 per cent of the 
improvement in his lobotomized patients 
had occurred by the end of the third post- 
operative week has not been a general find- 
ing and possibly reflects a selection of 
tests of an inadequate range of difficulty. 
Certainly studies of this type, involving 
objective pre- and post-testing of lobotomy 
patients, can stand considerable replica- 
tion. Ina recent review of the literature 
on psychosurgery (1936-1949), this 


writer found that less than 10 per cent of 
the approximately 5,000 reported cases 


had received any type of measurement 
before and after operation. 

In the area of abbreviated tests, 
Mensh’s"!!) study is one of the most im- 
portant contributions of the past year in- 
asmuch as it constitutes a carefully con- 
trolled examination of a very basic as- 
sumption in test abbreviation, namely, 
that the response to individual items is un- 
affected by abbreviation of a test. His 
findings support this assumption. His 
data indicate further that the order of 
difficulty of items in a test is a very im- 
portant determiner of goodness of per- 
formance on those items, an irregular 
order of difficulty making for poorer per- 
formance. The relative difficulty of items 
and their order in a test is a matter which 
seems frequently to be given inadequate 
consideration by test constructors. 

The first five categories of Table 1 in- 
clude approximately 50 per cent of the 
tabulated research studies. It would ap- 
pear that these categories present a rep- 
resentative picture of the areas of re- 
search which have received major atten- 
tion from clinical psychologists in 1949, 
With respect to type of research, it is of 
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interest to note that 31 per cent of the 
studies (Categories No. 1, 7, 11, 13, 14 
and 15) are concerned with validity and 
19 per cent (Categories No. 3, 8, 10 and 
12) with the establishment of norms. 
Most “front-line” workers will probably 
agree that the concentration of studies in 
these areas indicates a fairly good attune- 
ment of research activities to pressing 
clinical needs: more valid and economical 
instruments, more valid techniques, and 
more extensive normative data. How- 
ever, there appears a great need for re- 
searchers to become increasingly con- 
cerned with the criteria against which they 
may evaluate their instruments and proce- 
dures. 

Space does not permit an adequate re- 
view of the studies contained in the re- 
maining categories of the table. In view 
of clinical prominence, it is pertinent to 
refer to the studies recorded in Categories 
No. 7 and No. 18 which are concerned re- 
spectively with the validity of diagnostic 
patterns from the Wechsler-Bellevue™: ° 
%,21) and of the deterioration index de- 
rived from this test: !©. Results from all 
six studies may be summarized briefly: 
they indicate that the Wechsler-Bellevue 
diagnostic patterns and deterioriation in- 
dex are not valid. Hunt“, using data pro- 
vided in Wechsler’s manual indicates 
which of the subtests actually do and do not 
“hold” with increasing age and suggests a 
revised index of deterioration for which 
he provides norms. Disappointing though 
it may be to the busy clinician who would 
like to derive many kinds of information 
from a single instrument, it appears that 
the Wechsler may be validly used only 
for the purpose for which it was primarily 
constructed—to measure adult intelli- 
gence. 
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INTRODUCTION 


It is generally accepted in psychiatric 
practice that the study of personality must 
consider the total configuration, the ge- 
stalt. However, it must be recognized 
from a consideration of the practical as- 
pects of research that it is not yet possible 
to study the total personality without 
analyzing various of its components rel- 
atively separately. The complexity of the 
personality demands in our present state 
of learning that personality study deal 
with segments, facets, areas, or regions 
of the personality, call it what one may. 
Thus, we speak of the emotions, the intel- 
lect, defenses, adjustment mechanisms, 
and a number of other factors. Then we 


footnote such elemental discussions with 
the cautions that, (1) these factors are 
but part of the total picture, and (2) their 
interrelationships are of utmost  signiti- 
cance. 


Because of the need for objectivity and 
for statistical study of personality, and 
because of the practical demands of re- 
search as limited by present-day knowl- 
edge, it is felt‘that it is necessary to re- 
duce to elements certain of the character- 


istics of the personality. This is done 
with the limitations of such treatment in 
mind, balanced against expected contribu- 
tions which can be made through this 
technique. lor example, the necessity for 
rating personality variables in order to 
objectify data and put them in order for 
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statistical treatment, arising from an ex- 
perimental design for evaluating psycho- 
therapy in neurosis, led to the present 
study. 

PROCEDURE 


More than ten years ago, Allport and 
Odbert™?) published an extensive collec- 


tion of “trait names,” listing 17,953 terms. 


These represent the population from 
which were drawn the samples to be de- 
scribed. On the basis of frequency of ap- 
pearance in clinical terminology, 400 of 
the nearly 18,000 terms were chosen for 
further study. From these, 171 were se- 
lected on the basis of independence of 
meaning and frequency of appearance in 
clinical terminology dealing with psycho- 
neurosis. The 171 terms were arranged 
randomly and given to six first-year psy- 
chiatrists and eight practicing psychia- 
trists. These two groups were asked to 
indicate in which of the 171 terms repre- 
senting personality variables would 
changes during psychotherapy be ex- 
pected, and which of these were most sig- 
nificant to the course of therapy. 

Using as criterion-50 per cent or great- 
er agreement among the 14 psychiatrists, 
70 variables were selected. Of these 70 
items, 56 were drawn from the 171 terms, 
and 14 additional items came from sug- 
gestions of the 14 raters. The 70 terms 
then were placed randomly and_ three 
questions were asked, concerning the 
70 terms, of each of three cooperating 
groups—tive first-year and six second- 
year residents in psychiatry, and seven 
psychiatrists of diverse psychiatric ori- 
entation who had been in practice for 
periods ranging from four to fourteen 
years. First, they were asked to check 
those characteristics in which changes 
would be expected in the course of ther- 
apy. Next, the raters were asked to indi- 
cate those variables most significant to 
therapy, i.e., treatment goals. The selec- 
tions based on the two questions were, of 
course, not mutually exclusive. Finally, 
the groups were asked to indicate those 
factors which would not change under 
any circumstances. In both of the rating 
series, for the 171-and 70-item forms, the 
rating was done individually, each psy- 
chiatrist drawing from his own experience 
and not from group opinion or discussion 


except as part of his background expe- 
rience, 

Some of the raters reported that they 
could think of the terms as symptom names 
only. Others among the groups noted 
that it was difficult 1f not impossible to 
think of an individual under treatment, 
in terms of the elemental, non-gestalt, to- 
tality-lacking personality characteristics. 
Still others felt it was not possible to gen- 
eralize in rating the variables; that one 
had to think of a specific individual in 
order to complete the ratings. These com- 
ments pay tribute to the emphasis in psy- 
chiatry on the concept of the study of the 
total personality. Nevertheless, all but 
one rater completed the selection on the 
70-item form. Further, of the 70 possible 
ratings by each of the 17 raters, a total of 
1,190 ratings, there were but 30 omissions, 
an omission rate of two per cent. 


RESULTS 


Tabulation of the ratings by the 17 rat- 
ers on the final 70-item form was done on 
two bases. Each of the 70 terms was 
tabulated by question (1, factors expected 
to change in therapy; 2, treatment goals; 
3, factors not expected to change under 
any circumstances), and by group (1, 
five junior, first-year psychiatric resi- 
dents ; 2, six senior, second-year residents ; 
3, six staff, practicing psychiatrists ). 
Table 1 shows the number of variables 
rated on which there was 60 per cent or 
better agreement within the rating group. 

Examination of the distribution of 
variables under Column 1, factors ex- 
pected to change in the course of therapy, 
shows 60 per cent or better agreement on 
a substantial number of the total 70 terms 
rated.’ The second-year residents agreed 
on all but one term, the first-year 
group on 64 of the 70, and the psychia- 
trists in practice agreed on three out of 
four terms. Thus, there was mean agree- 
ment of the three groups of raters on 88 
per cent of the 70 terms when they con- 
sidered them as factors expected to change 
in therapy. These data validate in sig- 

1. It can be seen that 40-60 per cent agree- 
ment involves a nearly complete division in a 
group, with about half the raters voting one 
way and the other half another way. Thus, 
there 1s no majority opinion. Therefore, the 
selection of 60 per cent as “cutting” point. 
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Tasle 1. Number of variables rated (total N 70) on which there was 60 per cent or 
better agreement within the rating group. 


Column 1 


(Change expected ) 


60+ % W+% 10% O+% 


Column 2 Colunm 3 


( No change expected ) 
80 4+ % 100% 60 + % 80+% 100% 


33 15 

5 30 6 

Staff (N 6) 5 16 27 
Mean 26 16 


* The 60 + % column includes the 80 + % column and the latter includes the 100% column. 
Thus, in the Jr. group, on 64 of the total 70 items there was 60 + % agreement, of these 64 items 
46 showed 80 + % agreement, and on 33 items there was complete (100% ) agreement. 


nificant measure the earlier selection of 
the 70 terms described above. 
- It is interesting that the second-year 
residents, who had trained together for a 
year, showed agreement on most items ; 
the first-year group, though new to psy- 
chiatry, agreed on nearly as many items; 
but the group with 4-14 years of psychiat- 
ric practice agreed on 19-25 per cent 
fewer items than the less experienced 
groups. This trend is emphasized in the 
100 per cent column of Table I, where 
twice as many terms rated by the resi- 
dents showed complete agreement as com- 
pared to the staff psychiatrists who found 
this level of agreement on only 16 of the 
70 terms. It was the latter group which 
consistently agreed on fewest items. The 
distribution in Column 1 suggests that, 
although the psychiatric training of the 
residents results in a greater uniformity, 
the psychiatrist in practice is more indi- 
vidualistic in his thinking. This appears 
with reference to personality variables ex- 
pected to change during therapy. How- 
ever, it should be noted that the six senior 
residents were individuals were 
among the 14 in the original rating group. 
This suggests that the ratings show a con- 
siderable degree of consistency that 
they re-rated 69 of the 70 items in the 
same direction after the lapse of a year. 
Further, a study of the reliability of 
the ratings of nine of the 17 raters was 
made. This group of nine was composed 
of all who had been among both the’ 14 
raters of the 171-item form and the 17 
raters of the 70-item form. The reliability 
check showed that the nine raters had 
been consistent in their ratings of 61 per 
cent of the 56 terms which were common 
to both the 171- and 70-item forms. Al- 


though in some instances items were re- 
rated differently by as many as two-thirds 
of the raters, on half the items there had 
been changes in the ratings by three or 
fewer of the nine raters after a year’s 
interval. The mean number of raters 
among the nine who showed consistency 
in their rating and re-rating of the 56 
terms was 5.5, with a range of 3-6. 

The ratings of treatment goals present 
a different picture. It 1s the experienced 
practitioner who agrees with his  col- 
leagufes most frequently —OO-+-. per cent 
agreement on 27 of the 70 personality 
factors—while the residents agree on 
treatment goals at this level on only 6-15 
of the terms. The practicing psychiatrists 
agree on fewer personality factors likely 
to change in therapy, but can agree on 
more than half of this selection as treat- 
ment goals, a 52°27 ratio which is much 
more favorable than the 64/15 and 69.6 
ratios of the residents. Moreover, on 10 
of the 27 terms the staff agreed at the 
8O per cent level, a degree of agreement 
reached by the residents on only 2-4 of 
the variables rated. 

Finally, it can be seen in Table 1 that 
column 3 complements column 1. Agree- 
ment on many items in column 1 would 
necessarily mean that few items would 
remain in which change would not be ex- 
pected. Where the totals of the 60 + % 
columns under questions 1 and 3 do not 
add to 70, as with the second-year resi- 
dents and the practicing group, the re- 
maining items (15 in the case of the latter 
raters) did not show better than 40-60 
per cent agreement, indicating a nearly 
even division of opinion in the rating 
group. 

In brief, the preliminary selection of 
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Taste 2. Changes in personality variables expected in therapy, and treatment goals. 


Changes Goals Changes Goals 
Je. we, St: at 
Res. Res. Stf. Res. Res. Stf. Res. Res. Stf. Res. Res. Stf. 
submissive — * suspicious 
destructive introspective 7 
self-conscious self-deprec. 
moody + * | distractible * 
anxious * | timid — 
1. “% agreement Change No Change 
60 * + 
80 ** +7 
100 


the 70 personality variables generally was 
validated by the ratings of the three 
groups of raters. Further, there was 
agreement among the residents on all but 
a few items, and by the practicing group 
on three out of four items, when they 
evaluated the 70 terms as personality fac- 
tors expected to change in the course 
of psychotherapy. More uniformity of 
opinion on this question thus was noted 
among the residents than among the ex- 
perienced practitioners. However, on 


treatment goals the latter were much more 
in agreement than the residents, and the 
second-year residents agreed on only six 


of the 70 items as treatment goals, less 


than half the number agreed on by the 
first-year group, and less than a fourth 
of the number agreed on by the staff 
group. 

The over-all summary of ratings just 
presented is elaborated in Table 2, which 
shows the distribution of ratings for the 
70 specific terms under study. Three 
personality variables stand out, with 
agreement of 60 per cent or better within 
each of the three groups, both as factors 
expected to change and as_ treatment 
goals—"‘emotionally inhibited,” ‘“*imma- 
ture” and “unassertive.” A second clus- 
ter of six factors appears, rated by all 
groups as expected to change and by all 
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but the second-year residents also as treat- 
ment goals. Thus, with the latter ex- 
ception, there is agreement on “‘discon- 
tented,” “passive,” “insecure,” ““frus- 
trated,” “guilty” and “indecisive.” Sim- 
ilarly, there is agreement among all but 
the first-year residents on “hostile” and 
“unadaptive.” 

Of the seventy terms rated expected to 
change in therapy, the three groups agreed 
on 50, or more than 70 per cent. However, 
on nine personality variables there was 
marked disagreement. The residents rated 
in agreement among themselves “rigid,” 
“inadequate” and “compulsive,” indicat- 
ing these would be expected to change 
during psychotherapy. The practicing 
psychiatrists rated these same factors as 
ones not expected to change. The first- 
year residents did’ not expect change in 
the variables “‘suggestible,”  “introspec- 
tive’ and “persistent,” but the second- 
year group did expect changes in these 
three factors. Also, the former group did 
not expect change with respect to “emo- 
tionally intense” though the practicing 
group rated this in substantial agreement 
among its members as a factor expected to 
change. And the first-year residents dis- 
agreed with both of the other groups in 
rating “moody” and “domineering,” giv- 
ing as their opinion that these two factors 
would not change, while the more senior 
psychiatrists rated these factors as ex- 
pected to change. In these nine charac- 
teristics then, treated as personality vari- 
ables either expected to change or not ex- 
pected to change in the course of psycho- 
therapy, there were marked divergences 
of opinion among the three groups of 
raters. 

As previously noted, the extent of 
agreement on treatment goals was much 
less than agreement on factors expected 
to change in therapy. There was within- 
group and among-group agreement on 
only three personality variables, in con- 
sidering the 70 terms as treatment goals. 
This agreement came in rating “emotion- 
ally inhibited,” “immature” and “unas- 
sertive.”” However, there also was agree- 
ment by two of the three groups on “hos- 
tile,” ‘“‘discontented,” “passive,” “‘inse- 
cure,” “frustrated,” “guilty,” “unadap- 
tive” and “indecisive.” The first-year 


residents were alone in rating as treatment 
goals “submissive,” “destructive,” “terri- 
fied,” “depressed,” “unrealistic” and “hys- 
terical.”” Similarly, only in the second- 
year resident group was there as much as 
60 per cent agreement on “rigid” as a 
treatment goal. The experienced prac- 
titioners rated in agreement among them- 
selves but not with the other two groups 
16 additional treatment goals. Only on 
three, however—‘melancholic,” “uncom- 
municative’ and “discouraged” — was 
there agreement at a level as high as &5 
per cent. Agreement on the remaining 
13 was of the order of 67 per cent. These 
factors were “apprehensive,” “belliger- 
ent,” “emotionally intense,” “moody,” 
“dependent,” “listless,” “aloof,” “tense,” 
“fearful,” “anxious,” —“perseverative,” 
“aggressive” and “agitated.” 

In rating the 70 terms as treatment 
goals there was not much marked diver- 
gence of opinion among the three groups 
of raters (intergroup opinion). Yet in 
their consideration of treatment goals the 
17 raters of the three groups showed 
much less agreement among themselves 
(intra-group opinions) than they had 
shown on factors expected to change in 
the course of psychotherapy. This is seen 
in the 40-00 per cent agreement, indicat- 
ing a nearly even division of opinion with- 
in the three rating groups on 36 of the 
70 terms, or more than half the total num- 
ber. When the terms were rated as fac- 
tors expected to change there was not a 
single one of the 70 terms on which at 
least one group could not agree among its 
members to the extent of 60 per cent, and 
on all but five terms there was 80 per 
cent or better agreement. The cluster of 
five factors—“rigid,”. “moody,” “egotis- 
tic,” “introspective,” and 
tains only one-seventh the number of 
items on which there was a nearly even 
division of opinion when treatment goals 
were rated, and even on these five vari- 
ables a majority opinion was reached. 

Thus, there was agreement both within 
and among the three groups of raters on 
“emotionally inhibited,” “immature” and 
“unassertive” both as factors expected 
to change and as treatment goals. An- 
other cluster of factors appeared in the 
ratings showing agreement between two 
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of the three groups on both changes and 
goals in “discontented,” “passive,” “inse- 
cure,” “frustrated,” “guilty,” “indecisive,” 
“hostile” and “unadaptive.” Though 
there was agreement among all three rat- 
ing groups on an additional 50 of the 70 
items, in terms of changes expected in 
therapy, there was a marked divergence 
of opinion among the groups on “rigid,” 
“inadequate,” “compulsive,” “suggesti- 
ble,” “introspective,” “persistent,”” “emo- 
tionally intense,” “moody,” and “domi- 
neering.” In rating these nine factors, 
some groups checked them “expect to 
change,” and others checked the same 
items not expected to change. 

In their consideration of the 70 terms 
as treatment goals, the three groups of 
raters showed much less within-group 
agreement than they had shown in rating 
factors expected to change in the course 
of therapy. Of the 70 terms, 36 or more 
than half of the total number were rated 
by 40-00 per cent of the group members, 
indicating a nearly even division of 
opinion within the groups. The agree- 


ment on only 34 personality variables as , 


treatment goals is in contrast with the rat- 
ings of factors expected to change, in 
which there was not a single one of the 
70 terms on which at least one group had 
not agreed among its members to the ex- 
tent of 60 per cent, and on all but five 
terms—"rigid,” “moody,” “egotistic,” 
“introspective,” and “inert’”—there was 
80 per cent or better agreement within 
groups. This cluster of five factors ex- 
pected to change contains only one-sev- 
enth the number of items on which there 
was a nearly even division of opinion 
when treatment goals were rated, atid 
even on these five variables a majority 
opinion was reached. 


SUMMARY 


In the present study the sample of 
terms representing personality variables 
was originally drawn from the Allport 
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and Odbert list of nearly 18,000 terms. A 
series of selections by preliminary ratings 
reduced the number to 70. Three ques- 
tions then were asked, concerning the 
70 terms, of each of three cooperating 
groups—five first-year and six second- 
year residents in psychiatry, and seven 
psychiatrists of diverse psychiatric opinion 
who had been in practice for periods rang- 
ing from four to fourteen years. First, 
the raters were asked to check those 
characteristics in which changes would be 
expected in the course of therapy. Next, 
the raters were asked to indicate those 
variables most significant to therapy, 1.e., 
treatment goals. Finally, the groups were 
asked to check those factors which would 
not change under any circumstances. 

The results generally validate the pre- 
liminary selection of the 70 personality 
variables used in the study. There was 
agreement by 60 per cent or more of the 
residents on more than 90 per cent of the 
items, and by the practicing group on 
three out of four terms, in considering 
personality factors expected to change in 
therapy. More uniformity of opinion on 
this question thus was found among the 
residents than among the experienced 
practitioners. However, on treatment 
goals the latter were much more in agree- 
ment than the residents, and the second- 
year residents could agree on only six of 
the 70 items as treatment goals, less than 
half the number agreed on by the first-year 
group, and less than a fourth of the num- 
ber agreed on by the staff group. 

On analysis of the specific personality 
variables, significant clusters of agreement 
on terms appeared. One of the most sig- 
nificant facts to emerge was the agree- 
ment among experienced psychiatrists of 
rather diverse orientation as to treatment 
goals. 
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THEMATIC APPERCEPTION REACTIONS OF CRIPPLED 
CHILDREN 
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School of Education, Syracuse University 


PROBLEM 


Thorough understanding of the needs, 
problems, and attitudes of children who 
are distinguished by the fact of physical 
disability is greatly needed. Understand- 
ing of this question may be gained 
through the projective techniques. Re- 
search utilizing projective devices in the 
examination of crippled children is ex- 
ceedingly scarce. It is our opinion that 
the employment of such techniques in re- 
search will considerably aid in the devel- 
opment of insight into the psychology of 
crippled children. 

This study represents a preliminary at- 
tempt to utilize a modified form of a new 
thematic projective test, the Symonds 
Picture-Story Test, in the investigation 
of the fantasy productions of a group of 
crippled children. The Symonds Picture- 
Story Test was designed for use with chil- 
dren of adolescent age thus lending itself 
more readily to the projections of subjects 
at the younger age levels than the more 
widely used Murray Thematic Apper- 
ception Test’, The present study was 
originally planned as an extension of a 
specific problem area noted for crippled 
children. Two earlier studies by Cruick- 
shank and Dolphin“: indicated that 
crippled children demonstrated, con- 
trast to several other areas of emotional 
adjustment, a need to be free from intense 
feelings of fear. Although the crippled 
and non-crippled children were similar in 
this regard, it is desirable, in order to ade- 
quately plan for the former group, to as- 
certain the nature of the feelings of fear 
which have been indicated. 

The data of this study, however, went 
somewhat beyond the specific aim enu- 
merated above and did not lend itself en- 
tirely to interpretation in terms of the 
Cruickshank and Dolphin. studies. Al- 
though the authors structured this pres- 
ent investigation in terms of the frame- 
work of the previous studies, they at- 
tempted to utilize the obtained data to the 


fullest in delineating factors in personal- 
ity dynamics other than the one stated in 
ithe original purpose, 


PROCEDURE 


The subjects utilized in this study were 
thirty children enrolled in a public school 
for exceptional children. There were fif- 
teen girls and fifteen boys ranging in age 
from ten to twenty. The average age was 
fourteen. They were included in grades 
from five to twelve, inclusive, the average 
grade being the eighth. The group was 
composed of children with cerebral palsy, 
arthritis, rheumatic fever, and poliomye- 
litis. These thirty subjects were selected 
from the sample of crippled children used 
by Cruickshank and Dolphin. They were 
divided into three groups: A, B, and C. 
Group .\ included seven children ; B, thir- 
teen; C, ten children. The three groups 
were developed on the basis of the child's 
expressed need to be free from intense 
feelings of fear as determined through the 
use of the Raths Self-Portrait N Test’. 
Gsroup -\ is defined as the group where the 
need to be free from feelings of fear was 
over-met; Group B, normal with respect 
to this need; Group C, where the need 
was not being met. 

Ten of the twenty pictures from the 
Symonds Picture Story Test were uti- 
lized. Ten competent judges cooperated 
in the selection of the final series of pic- 
tures, namely those pictures which would 
best give insight into the nature of anxiety 
and fear in the crippled children. The 
final selection included pictures num- 
bered: B7, Bo, A6, BY, BS, B3, A4, BI, 
B10, and A3. 

After a preliminary interview aimed at 
establishing maximum rapport and inter- 
est the instructions embodied the 
Symonds’ manual were given. The sub- 
jects were individually tested and_ their 
stories were transcribed in long hand as 
nearly verbatim as possible. 
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Taste 1. Significance of the difference in the number of themas produced by the three groups of 
crippled children 


Total frequencies 
for three groups 

B 

N=13 N=10 


A 


Themas 


A 


Mean 


frequencies 


20 
39 
16 
13 


Aggression 
Economic concern 
Punishment 
Separation 
Eroticism 
Style 

Anxiety 
Altruism 
Depression 
Success 

School 

Positive emotion 
Repentance 
Accident 

Social 
Thinking 
Escape 
Morality 
Strange 
Appearance 
Evil 

Jealousy 

Guilt 

Oedipal 
Rejection 
Inadequacy 
Independence .. 


tote 


. 


Method of Analysis. After the tests had 
been administered each of the three hun- 
dred stories was carefully studied. An at- 
tempt was made to find the significant and 
meaningful themas. For quantitative anal- 
ysis the themas were identified according 
to Symonds’ categories. At the time of 
this study there was no information which 
specifically defined these categories. The 
present authors agreed on criteria which 
were used to determine the category of a 
given thema, according to the criteria im- 
plied in Symonds’ categories. However, 
there were certain of his categories which 
were meaningless to the writers, ¢.g., 
“age,” “excitement,” “thinking,” “‘con- 
cealment,” “place of residence.” Also it 
was felt necessary to add categories to the 
list in order to cover certain observed 
themas. Those added were “oedipal,” 
“rejection,” “feelings of inadequacy,” and 
“need for independence.” 

In addition to analyzing the individual 
stories on a quantitative basis the authors 


wrote an interpretative summary for each 
subject. An individual’s summary was 
based on the total ten stories which he 
told. This part of the qualitative analy- 
sis was done to surmount the: limitations 
of the Symonds’ categories mentioned 
above. The attempt more specifically was 
to obtain a brief integrated picture of the 
particular individual's personality dynam- 
Ics. 
RESULTS 


Quantitative analysis. Symonds’ twenty- 
four categories, plus four added by the 
present authors, were used to describe the 
themas. The frequency of each thema 
was determined for each individual. For 
each thema an analysis of variance was 
calculated to test whether the mean fre- 
quencies of the three groups differed sig- 
nificantly. The F for the social thema was 
4.38 which is.significant at the .025 level 
of probability. The ¢ test for the differ- 
ence between group means was used to 
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compare Group A with Group B and 
Group B with Group C. The t value com- 
paring A with B on the social thema 
yielded a P less than .05. This t was not 
considered significant because in comput- 
ing fifty-six ¢ ratios the chance occur- 
rence of one significant f in five is prob- 
able. The t value for C and B was 2.9 
which was significant at the .O1 level of 
probability. There were no other signiti- 
cant F’s, Although not customary, the t's, 
as described above, were calculated for all 
themas regardless of the non-significant 
F’s. Table 1 gives the names of the 
themas, the group frequency, and the 
mean frequency for each thema, Only the 
significant t's and their respective ? values 
other than the one noted above, are to be 
found in the extreme right hand columns. 
The ¢ for the difference between the means 
of Groups B and C showed that Group B 
had significantly higher number of 
morality themas. The value in this in- 
stance was 7.3 which was significant at the 
one per cent level of probability. Group 
B also had a significantly larger number 
of guilt themas than did Groups A or C. 
The t’s were 3.2 and 3.4 respectively, and 
both of these values are significant at the 
one per cent level of probability. 


Discussion 


It is interesting that the children in 
Group C whose results on the Self-Por- 
trait N. Test indicated that their need to 
be free from feelings of fear was being 
under-met, produce the greatest number 
of social themas. Frequently these chil- 
dren expressed the desire in their stories 
for social acceptance and social participa- 
tion. On the other hand the children in 
Group .\ whose need to be free from fears 
is grossly over-met also produce a large 
number of social themas. The signifi- 
cance of this is undoubtedly the same for 
Group A as for Group CC. The earlier 
study of these children”? showed that the 
children of Group A were also those 
whose need for love and protection was, 
as with the fear factor, over-met. These 
crippled children who are over-protected 
and sheltered to an extreme show in their 
themas hesitancy and insecurity about en- 
tering into social activities. The wish for 
social participation is nevertheless present. 


Conversely, children in Group C whiose 
fears were not alleviated also expressed 
caution concerning social situations. The 
children of Group C produced almost tour 
times as many social themas as did the 
children of Group B. 

For further corroboration the authors 
studied the thirty protocols and noted 
those which clearly and predominantly ex- 
emplified a need for social participation, 
This analysis was made without cogniz- 
ance to which group (A, B, or C) the in- 
dividual belonged. It was found that thir- 
teen, or forty-three per cent, of the sum- 
maries were characterized by this need. 
Of the thirteen, it was found that twelve 
were produced by members of either 
Group A or Group C. Careful analysis 
of the individual stories tends to support 
the conclusion reached in the paragraph 
above, namely, that in those crippled chil- 
dren whose adjustment is impeded by the 
presence of intense feelings of fear, there 
ensues a need for greater social acceptance 
by the peer group and for social activities 
among those peers. 

A second area in which significant dif- 
ferences prevail concerns the themas deal- 
ing with guilt. Children of Group B, 
whose need to be free from feelings of fear 
is within normal limits, produce almost 
five times as many guilt themas as Group 
A and more than twice as many as the 
children of Group C. Children of Group 
B also produce more morality themas than 
did children in Groups .\ and C. The dit- 
ference in this latter comparison, with 
Group A, however, is not statistically sig- 
nificant. Although it is speculative, the 
following hypothesis is offered as a tenta- 
tive explanation of these observed facts. 
Morality is developed, at least in part, 
through social interaction both in and out 
of the family. It was found that Groups 
A and C had a significantly greater num- 
ber of social themas and the qualitative 
analysis showed these themas to be ex- 
pressive of a need tor social acceptance 
and social participation. Thus the fact 
that children of Groups A and C produce 
fewer morality and guilt themas may re- 
flect on their lack of social judgment, 
social experience, and social maturity, 
Group B children, perhaps because of a 
lack of fear which serves as an inhibiting 
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force, experience social activities to a 
greater degree. (ut of such activities ex- 
periences may occur which produce feel- 
ings of guilt on the part of this group of 
crippled children. 

The hypothesis stated in the preceding 
paragraphs is further substantiated when 
the anxiety themas are considered. It is 
of note that the mean number of themas 
which reflect anxiety, while not  signifi- 
cantly different, was greater for Groups A 
and C than for B. This finding is closely 
related to the original basis on which the 
groups were selected. Fear and anxiety 
are closely related. It is to be observed 
that the children who deviate insofar as 
feelings of fear is concerned also pro- 
duce more themas demonstrating anxiety. 
Those children who relate stories showing 
anxiety are those who evidence need for 
social acceptance and social participation. 


Qualitative analysis. Due to the general 
difficulties involved attempting to 
quantify projective material and due to 
the s) ecific inadequacies of the quantita- 
tive breakdown employed in this study, an 
attempt was made to cull from the inter- 
pretations and protocol material trends 
and characteristics which seemed to ap- 
pear in a number of productions. Of sig- 
nificance in the themas is the lack of overt 
mention of physical disability in the char- 
acters (heroes) with whom the subjects 
identified. Although there is an occasion- 
al mention of illness, it is not frequent and 
there is a complete lack of stories which 
involve crippled or handicapped individ- 
uals. 

Several hypotheses may be advanced to 
explain this rather interesting phenome- 
non. First, it may be that the test em- 
ployed is a good enough instrument to 
pick up the subtleties of these children’s 
preoccupation with their handicap without 
directly tapping it in manifest form. Sec- 
ondly, it also may be that in this group of 
thirty children none perceived their handi- 
cap as a realistic barrier and thus have no 
concern or preoccupation with it. Finally, 
it could be argued that these children are 
consciously repressing recognition of their 
handicap. 


The first hypothesis can be meaningful 
in the strictest sense only if a careful con- 
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trol group is used and such was not avail- 
able in the current study. However, it has 
been shown elsewhere that the children 
who were tested in the current study 
when a part of a larger group of crippled 
children and when compared with a like 
group of non-crippled children were strik- 
ingly similar to non-handicapped children. 
No statistically significant differences ap- 
peared between crippled and non-crippled 
children on any one of eight emotional 
needs evaluated®@’. It can be assumed 
generally that the crippled children herein 
tested are similar in the aspects of adjust- 
ment studied in the current investigation 
to non-crippled children. The possibility 
that these children are consciously re- 
pressing the recognition of their handicap 
has not been investigated. However, as 
yet unpublished data involving responses 
of nearly three hundred crippled children 
to a projective sentence completion test, 
would tend to adequately support the find- 
ings of the current study and to confirm 
the validity of the lack of overt reference 
to a physical disability or illness. Al- 
though the grounds are admittedly tenu- 
ous, it would appear that the first men- 
tioned hypothesis is more valid. 

It will be noted in analysis of the 
themas that a large number revealed anx- 
iety and difficulties in the home situation. 
In addition, there appears to be a constant 
reference to economic matters. \ need to 
be economically independent is expressed 
frequently and resentment of economic 
dependence is voiced by the crippled chil- 


‘dren. 


Of interest also were the frequent mis- 
perceptions which occurred on Card b3, 
a picture portraying two rather young 
males. Nine of the subjects or thirty- 
three per cent, perceived one of the figures 
(the right-hand figure) as a female. Of 
the nine subjects, five were females and 
four males. Although the figures were 


constructed to be equivocal in terms of 


sex, the significance of such mispercep- 
tions do not readily lend themselves to 
interpretation with this population. Rapa- 
port?) and Stein'?? have suggested that 
misrecognition of the sex of the figure on 
certain ambiguous cards of the Thematic 
Apperception Test may be related to 
homoerotic or strong feminine tenden- 
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cies in adult males. ‘The possibility of 
such tendencies on the part of the four 
males was not investigated here and the 
meaning of the female subjects’ misrecog- 
nition can not be demonstrated at this 
time. However, it may be postulated that, 
broadly speaking, perceptions which devi- 
ate from agreed-upon reality are sugges- 
tive of psychopathology. One of the sub- 
jects, a girl, not only misperceived the fig- 
ure on Card B3 but also misrecognized 
the sex of the figure in Card A4. She was 
the only subject who did so. In view of 
the above postulate it is interesting to 
note that this subject presented a rather 
serious picture of maladjustment. The 
themas which she produced portrayed, 
very vividly, an oppressive and demoraliz- 
ing home situation wherein she was hav- 
ing to assume responsibilities not equal to 
her social and emotional maturity. In ad- 
dition, there is evidence of delinquent 
ideation. This interpretation has been 
corroborated by material gathered about 
the subject from the school records. In 
conclusion, it may be stated that the prob- 
lem of misrecognition of the sex of the 
figures on the cards is one which war- 
rants further careful investigations before 
very definitive statements regarding its 
significance may be made. 

Another apparent group feature which 
may warrant some discussion was_ the 
marked paucity of some of the protocols. 
The average length of most of the stories 
was approximately thirty to forty words. 
They frequently were also devoid of what 
might be termed rich imagination. What 
conclusions were drawn from these par- 
ticular protocols were done so reluctantly 
because of the above fact. Murray writes 
concerning the Thematic Apperception 
Test that, “Stories from a sane adult aver- 
aging less than 140 words per story usual- 
ly indicate lack of rapport and cooperation, 
lack of self-involvement. As a rule they 
are not worth scoring™?.” There is no 
data at this writing on the average length 
of stories necessary to deal validly with 
those elicited by the Symonds Picture- 
Story Test. The authors feel that lack of 
self-involvement may be functioning here. 
The authors also question the suitability 
of the test for pre-adolescent children. 
The subjects who had at least chronologi- 


cally reached fourteen years of age or 
above tended to produce protocols of a 
more self-involved and more complex na- 
ture. Another hypothesis may be ad- 
vanced that the paucity of the stories may 
be qualitatively significant of a generally 
constricted and non-committal attitude or 
feelings of inadequacy in the situation. 


SUMMARY 


A modified form of the Symonds Pic- 
ture-Story Test was administered to thirty 
crippled children in a preliminary investi- 
gation of the usefulness of the instrument 
in psychological diagnosis of orthopedical- 
ly handicapped children. ‘The study was 
also undertaken to ascertain the psycho- 
dynamics involved in three groups of 
crippled children which deviated from one 
another insofar as the presence of feelings 
of fear is concerned, 

There is evidence that the sample used 
in this study consists of children deeply in 
need of and striving for social acceptance 
particularly among their peers. Of ma- 
jor importance is the finding that the 
presence of feelings of fear is coupled with 
an evidenced desire to experience social 
participation. It is also to be observed 
that crippled children who participate in 
group social activities experience signiti- 
cant guilt feelings. The need for thought- 
fully planned guidance and counseling 
services for crippled children and their 
families, and for realistic education of 
handicapped children is indicated herein 
once again. 

The study also shows that mispercep- 
tions, as regards the sex of the figure on a 
certain equivocal card of the Symonds 
Test (Card B3), occurred with approxi- 
mately one-third of the subjects and may 
be indicative of maladjustment. The evi- 
dence here is very meagre but is tentative- 
ly corroborated by school records in one 
case and indirectly by investigations with 
the TAT elsewhere. 


Qualitatively, it appears that the Sy- - 


monds Picture-Story Test is an efficacious 
device in revealing those, from among a 
group of handicapped children, who are 
extremely maladjusted. It may be con- 
cluded that the Symonds Test can be gain- 
fully used with handicapped children to 
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uncover significant dynamics of behavior 
and adjustment. 

Consistent with the original intent of 
the Test, the obtained data seem to indi- 
cate that the most fruitful application of 
the technique is with pubescent and post- 
pubescent subjects. It is suggested that 
further verification and exploration of the 
obtained data may be made through the 
use of a control group, which is planned 
for future research. 
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§ RORSCHACH SIGNS OF HOMOSEXUALITY IN 
MALE COLLEGE STUDENTS 


LEAH GOLD FEIN* 


Seattle, Wash. 


INTRODUCTION 


It is claimed, generally, that homosex- 
ual tendencies in males can be detected in 
Rorschach records. This claim is based 
upon clinical evidence reported in’ Ror- 
schach literature since 1945. Prior to 
1945 no attention seems to have been 
given to this problem in Rorschach litera- 
ture. The present paper attempts to de- 
termine which, if any, of the reported 
Rorschach signs are actual functions of 
homosexuality in male college students. 

In 1945 Harrower-Erickson®? stated: 
“Suggestions of homosexual trends were 
often noted in the blind analysis of the 
overt homosexual group of the sexual 
psychopaths. This group gives responses 
suggesting confusion in the body image 


* The writer wishes to acknowledge her grati- 
tude to Dr. Charles Strothers, of the Univer- 
sity of Washington, for reviewing this study 


and for his helpful suggestions. Appreciation 
is also offered to Drs. Dudek and Edwards of 
the University of Washington and to their staff 
for their examination of the data in terms of 
statistical treatment. 


in regards to the sex role and utilizes ob- 
jects of primarily feminine interest”©: 
yp 235) Also in 1945, at the Summer 
Workshop of the Rorschach Institute 
held June 10-24th in upper New York 
State, Dr. Bruno Klopfer listed several 
Rorschach signs as suggestive of homo- 
sexual tendencies in. males. His sugges- 
tions included: 


Where male and female are seen in 
svinmetrical blot areas. 

A passive, submissive orientation in 
Sex. 

Responses including buttocks, anus, 
rectum and head between legs. 

Men with feminine attributes. 


Rapaport) referring to homosexual 
signs in the Rorschach stated: 


z a response in which 
two symmetrical figures are described as 
male and female in our experi- 
ence has usually been an indication of 
homoerotic strivings’” 349), 


| | 
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In addition to the clinical data on 
homosexual signs in the Rorschach, some 
“statistical” data have appeared in the 
literature since 1945. The first reported 
study on this problem was made by Berg- 
man, who gave Rorschach Tests to 20 
males of military age (average age 24 
years) whose homosexuality had been 
established clinically. Bergman reports 
that 15 of the 20 men gave one or more 


of the following Rorschach responses‘! 
p. 78-83). 


Sex organ ee with anxiety 
signs (m, CF, S 14 of 20 
Human with sexual or 
homosexual connotations 4 of 20 
Human movement indicating aver- 
sion to sexual 2 of 20 
Human movement with difficulty 
identifying sex of figure 6 of 20 
Male and female in symmetrical 
blot areas 4 of 20 


Since Bergman does not present com- 
parable data for a control group of non- 
homosexual males, we do not know from 
this study how frequently these signs oc- 
cur in Rorschach records of non-homo- 
sexual males of military age, nor do we 
know from this study how significant 
these signs are as homosexual indicators. 
Bergman himself casts doubt upon the 
significance of his findings by his obser- 
vations that sex organ responses occur as 
frequently or more frequently among neu- 
rotics with sex conflicts. Indecision con- 
cerning sex identity occurs in psychotics, 
and all these above listed signs occur in 
psychotic records™: ® 83), 

A second study of homosexual signs in 
the Rorschach was reported by Due and 
Wright’. The authors administered a 
modified group Rorschach to 42 adult 
males, clinically diagnosed as homosex- 
uals, Analysis of the content of re- 
sponses in these records showed frequent 
occurrence of the following “mechan- 
169-177) 


De-realization. 

Confusion of Sexual Ide tification. 
Feminine Identification. 

Castration and Phallic Symbolism. 
Sexual and Anatomical Responses. 
Esoteric Language and Art Refer- 
ences. 


Due and Wright present their findings 
as evidence that Rorschach content analy- 
sis, as well as traditional Rorschach de- 
terminants, is useful in diagnosing homo- 
sexuality. They point out that no one 
record is likely to show all the above men- 
tioned content factors, and further, that 
other psychiatric groups have a high in- 
cidence of some of these signs. This 
study is significant in that it presents ad- 
ditional Rorschach signs that may prove 
to be useful as indicators of homosexual- 
ity, but it fails tq demonstrate the sig- 
nificance of these signs for differentiating 
homosexuals from other clinical groups. 

A third study of homosexual signs in 
the Rorschach was reported by Wayne, 
et al. in 1947, The authors conclude 
that the traditional Rorschach categories 
are not useful in detecting homosexuality 
in males. In summary, it appears from 
the literature that content responses rath- 
er than traditional Rorschach categories 
may prove to be fruitful indicators of 
homosexual tendencies in males. How- 
ever, since these same content responses 
also occur in Rorschach records of other 
clinical groups, the significance of con- 
tent responses as indicators of homo- 
sexuality still remains to be established. 


PROCEDURE 


The present study will attempt to de- 
termine the frequencies of suggested 
homosexual content responses in Ror- 
schach records of 43 male college students 
attending a large cosmopolitan non-co- 
educational university in the eastern part 


of the country. The entire sample was 
of superior intelligence as determined by 
the university admittance requirements 
and all were from high average socio- 
economic backgrounds.’ This group of 
43 students included 9 who had been re- 
ferred to the college psychiatrist by stu- 
dent counselors, who had evidence that 
these students had participated in homo- 
sexual activities. These 9 students were 


_ clinically diagnosed as homosexuals.’ A 


1. In view of the age of these young men 
(average age 19) and in view of their high in- 
telligence level and their high socio-economic 
background, it may be expected that their homo- 
sexual practices would be more circumspect 
than the practices of older men of lesser intel- 
hgence and of lower socio-economic background. 


1. 
2. 
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second group within the large group of carefully exammed for the following 
43° students, included 10 students who © signs: 


sought psychiatric help because of feel- 1. De-realization 

ings of inadequacy. These 10. students a. Mythical distortion. 

were clinically diagnosed as anxiety neu- b. Qualifications toward the ab- 
rotics. The remaining 24 students were normal, 

normal students selected at random from c. De-humanization. 

a group of 300 freshmen who had _ vol- 2. Confusion of sex identification, 


unteered to participate in the research a. Double identification, 
study. These three groups will be re- b. Evasion of sex identification, 
tn ot the c. Uncertainty of sex identifi- 
sexuals (9): Neurotics (10), the 

Normals (24). The median age of the 3. Feminine identification. 


a. Feminine gender. 

b. Feminine behavior. 

c. Feminine apparel. 
Castration symbolism. 
Phallic symbolism. 


Homosexuals was 20 years, of the Neu- 
rotics, 19 vears, and of the Normals, 17 
years. The mean school year of the 
Homosexuals and of the Neurotics was 
the College Junior Year, while the Nor- Sex, anatomy, x-rav. 

mals were all Freshmen. Esoteric remarks and Art  refer- 

The students in each group were given ences. 

the individual Rorschach test and the 
content responses of each record were — marked +. : 


SIDA uit 


Tape 1. Showtng the percent of each group giving susbected homosexual signs on the Rorschach 
test, and the average numbey of suspected Rorschach signs per group. 


5 Per cent giving suspected homo- Average number suspected 

: sexual signs in Rorschach Rorschach signs 

} 

| Homo. Veurot. Normal Homo, Veurot, Normal 
Response categories N N=10 N = 24 


Mythical distortion .......... 
Qualifications toward the ab- 


100 80 72 8.0 1.8 
| 11 67 12 1.8 1.4 
Confusion of sex identification. 77 x0 2.3 1.5 
Feminine gender ............. 50 50 67 1.0 1.0 Lo 
Feminine behavior ........... 0 10 0 
Feminine apparel ............. 50 10 + a Re 04 
Castration symbolism ........ 77 30 20 3.0 4 4 
Phallic symbolism ....... yasace't x80 67 6.0 24 1.5 
Sex organs, anatomy, x-rays, 

Esoteric responses and art ref 

Paranoid reactions ......... ; 44 60 32 8 7 a 
Men with feminine attributes .. 22 C 4 = 04 


Anal, rectal, buttocks, head be- 


Human movement with sex or 

homosexual connotations .... 44 10° 1.0 
Male and temale in symmetrical 


ston to sex 


Activated sex organs ..... 50) 


Mean response per group 


% 
tween legs 30 & 1.0 
Sex organs with anxiety signs 
Human movement with aver- 
30 39 46 36 39 


RORSCHACH SIGNS 


Paranoid reactions. 
Men with feminine attributes: ex. 
Card Ill “Two men with penis 
but large breasts.” 
Buttocks, anal, rectal responses, 
head between legs. 
Sex organs with anxiety signs (1m, 
Human movement with sexual or 
homosexual ~ connotations: — ex. 
Card V ‘Two legs coming out on 
either side—that raped maidens 
manly legs with certain beauty to 
them.” 
Human movement with sex aver- 
sion: ex. Card Il “Buxom wo- 
man, typical daughters of Ameri- 
can Revolution—disgusting—you 
know the type, society dames.” 

14. Male and female in’ symmetrical 
blot areas. 

+15. Activated sex organs. 


Every record was carefully scrutinized 
for responses belonging to each of the 
15 categories listed, and every such re- 


sponse tor each individual was tabulated 
in order to determine: first, the percent 
of individuals in each group giving each 
response category; second, the average 
number of responses in each category for 
each group. The data in Table 1 show 
the per cent of each group giving  sus- 
pected homosexual signs, and the aver- 
age number of suspected Rorschach signs 
for each group.” 

It is important to note that the cate- 
gory which includes sex organs, anatomy 
and x-ray responses was narrowed down 
by eliminating from our tabulations all 
sex organ and anatomy responses that 
appear often enough in normal records 
and are of such good form as to have no 
pathological significance. Also any x- 
ray response which appeared in Cards | 
or Il and nowhere else in the record was 

2. These data cannot be stated statistically 
beyond percentage and average differences in 
view of the fact that the frequencies of response 
are not functions of every individual in the 
groups, but are functions of subjective factors 
within certain individuals in these groups. In 
view of these facts, no expected frequencies may 
be assumed, and consequently small sample 
techniques are not applicable. (This explana- 
tion was offered by Professors Dudek and Ed- 
wards and staff at the University of Washing- 
ton, Seattle, Washington. ) 
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also discounted“?’. The usual sex organ 
responses’? that were not counted 
include : 
Card IT, lower middle red .......... vagina 
Card Il, upper middle black ... ... penis 
Card VII, lower middle Dr. .. .. Vagina 


The usual anatomy responses ® in- 
clude: 
Card Lil, upper red sides, 
stomach and asophogus 
Card VIII, center white 1 
Card X, upper center gray, 
trachea and lungs 


Special attention was paid to responses 
involving activated genitals since such re- 
sponses are considered pathological indi- 
cators™ Although these responses 
were included in the general category sex 
organs, anatomy and x-ray, they were 
also tabulated separately and are recorded 
in the last column of each table. 


RrsSuLTS 


Analvsis of the data in Tables 1 through 
5 led to the following inferences : 


I. Responses that appear to be strong 
indicators of homosexuality in male col- 
lege students include: 


Feminine apparel. 

Feminine behavior. 

Men with feminine attributes. 
Human movement with sex conno 
tations. 

Male and female in’ symmetrical 
blot areas. 

Human movement with aversion to 
SEX, 


II. Response forms including sex or- 
gans, anatomy and x-rays (which include 
sex organs with anxiety signs, sex or- 
gans in blot areas other than those con- 
sidered good form, anatomy responses 
other than those considered common and 
in good form, anal, rectal, buttocks, head 
between the legs) appear to be as indica- 
tive of anviely concerning masculine viril- 
itv and expression of the masculine role 
in our culture as of homosexuality. How- 
ever, where such responses pile up in any 
one record, they raise suspicion of homo- 
sexuality (Table 2). 


7 

] 

> 
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Taste 2. Number of times sex organ, anatomy, 
x-ray responses appeared in individual records 
of each group. 
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Taste 4. Number of times castration symbolism 
responses appeared in individual records of 
each group. 


Frequency of 
responses 


Norm. 
(30%) 


Neur. 
(70% ) 


Homo. 
(100% ) 


Neur. 


Frequency of Homo. 
7 (30% ) 


responses o) 


Norm. 
(20%) 


III. Responses characterized by Quali- 
fications toward the abnormal seem to 
become homosexual indicators when such 
responses pile up in any one record 
(Table 3). Furthermore, homosexuals 
are far more likely to resort to the mech- 
anism of de-realization through qualifica- 
tions towards the abnormal than through 
mythical distortion or de-humanization. 
In fact, the category de-humanization ap- 
pears to be far more common to neurotic 
and normal male college students than to 
homosexual male college students (Table 


1). 


Tasie 3. Number of times qualifications toward 
the abnormal responses appeared in individual 
records of each group. 


Frequency of 
responses 


Homo. Neur. Norm. 
(100% ) (80% (72%) 


% o% 


70 00 
10 12 


Esoteric and art references appear 
to be suggestive of homosexual tendencies 
in male college students. 


\V. Responses characterized by castra- 
tion symbolism appear to become homo- 
sexual indicators when more than three 
occur ina record (Tables 1, 4). 


VI. Responses characterized by phallic 
symbolism tend to become homosexual 
indicators when such responses pile up 
ina record (Tables 1, 5). 


VIL. The response form feminine gen- 
der does not appear to be a function of 


% % 


30 20 


homosexuality. In fact, normal male col- 
lege students appear to give such re- 
sponses somewhat more freely than do 
homosexuals or neurotics. 


Taste 5. Number of times phallic symbolism re- 
Sponses appeared in individual records of 
each group. 


Norm. 
(67% ) 


Neur. 
(80% ) 


Homo. 
(100% ) 


Frequency of 
responses 


on 


40) 
30 
10 


VIIL. “Paranoid reactions” are not 
necessarily functions of homosexuality. 


IX. Responses manifesting confusion 
of sex identification appear, from this 
study, to be as much a function of inse- 
curity and uncertainty, in the male college 
student, concerning his male role in a 
new and challenging setting, as it is a 
function of homosexuality. It is quite 
likely that this category does serve as a 
differentiating homosexual sign in male 
adults. Should it be demonstrated, sta- 
tistically, that confusion of sex identifica- 
tion in the Rorschach does differentiate 
adult male homosexuals from normal 
adult males, then, in the light of the find- 
ings of the present study, the hypothesis 
would follow that homosexual practices in 
adult males, in our culture, are manifesta- 
tions of an earlier confusion, uncertainty 
and anxiety concerning their male role. 
It would further follow that male college 
students, who are not given adequate 
guidance and support during this period 
of confusion and uncertainty, are likelv to 
succumb to homosexual practices. 


|__| 
Jo % % 
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SUMMARY 


1. Forty-three male college students 
(9 homosexuals, 10 neurotics and 24 nor- 
mals) were given the individual Ror- 
schach Test. Test content was examined 
for responses which are generally con- 
sidered characteristic of homosexual ree- 
ords. 

2. Comparison of data obtained from 
the three groups indicates that: a. Re- 
sponses of feminine apparel and behavior, 
Men with feminine attributes, M = with 
sex connotations, Male and female in 
symmetrical blot areas, and M with sex 
aversion are homosexual indicators. — b. 
Esoteric language and art references are 
suggestive of homosexual tendencies.  c. 
Sex organ, anatomy and x-ray responses, 
qualifications toward the abnormal, cas- 
tration and phallic symbolism become in- 
dicators of homosexuality only when such 
responses pile up in a record. d. Femi- 
nine gender responses are not indicators 


of homosexuality. e. Paranoid reactions 
and confusion of sex identification are 
more indicative of insecurity and uncer- 
tainty than of homosexuality in male col- 
lege students. 
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THE PREDICTION OF ACADEMIC SUCCESS BY MEANS OF 
“WEIGHTED” HARROWER-RORSCHACH RESPONSES 


R. TRAVIS OSBORNE, WILMA B. SANDERS, AND JAMES E, GREENE 


The University of Georgia 


INTRODUCTION 


Since 1940 the Rorschach has been 
used in various ways in an effort to make 
informal or formal predictions of academic 
success and emotional adjustment in 
schools and colleges. Ruth Munroe‘? 
was one of the first Rorschach workers to 
recognize its value as a useful tool in edu- 
cational planning and research. In col- 
laboration with Klopfer, she conducted a 
pilot study at Sarah Lawrence College in 
an attempt to determine the validity of the 
test when used for informal evaluations 
of “run of the mine” college freshmen. 
Although no attempt was made to deter- 
mine the validity of the test in predicting 
college marks, Munroe reports “convine- 
ing validation” of test results by informal 
discussions with teachers. 


Helen Margulies) administered the 
individual test to equated groups of suc- 
cessful and unsuccessful grade school stu- 
dents. The purpose of her study was to 
investigate experimentally the  relation- 
ship of W-M ratio, color shock, and shad- 
ing shock to the effective use of mental 
capacities. Significant differences be- 
tween the two groups were reported. 

In 1943 Piotrowski@®? set up brief 
Rorschach formulae for the detection of 
eight psychological traits which he deemed 
essential to educational and vocational 
success. Each of these traits was de- 
scribed in terms of conventional Ror- 
schach components. Space does not per- 
mit adequate consideration of this sig- 
nificant contribution but it may be said 
that the approach was analytic and clin- 
ical in nature rather than statistical. That 
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is, NO attempt was made to determine the 
quantitative relationships of these traits 
to educational success. 

In 1945 several workers, including 
and Cowin™?, reported their use 
of the individual Rorschach in school sit- 
uations. Abel reports that mental defec- 
tives with records balanced with respect 
to H, A, P, and F+ make satisfactory 
progress in school work, whereas records 
with CF, C, and infrequent P make pocr 
academic progress. The Cowin study 
merely listed four major areas of useful- 
ness of the Rorschach in school situations. 

Five vears after her preliminary study, 
Munroe“? published her monograph on 
“Prediction of Adjustment and Aca- 
demic Performance of College Students 
by a Modification of the Rorschach Meth- 
od.” Among other findings, she reported 
that a modified Rorschach predicted aca- 
demic adjustment slightly better than did 
the ACE. By combining her inspection 
Rorschach predictions with ACE predic- 
tion categories, Munroe reports a “good 
prediction” was obtained for three-fourths 
of the group studied. 

The clinicians mentioned above pio- 
neered in studying the reliability and 
validity of the individual and group Ror- 
schach as an instrument for differentiat- 
ing between successful and unsuccessful 
students. In spite of demonstrated use- 
fulness both techniques remained methods 
requiring their own specialists and could 
not be considered psychological tests in 
the usual sense of the word’? 

In an effort to extend the sphere of 
usefulness of the Rorschach Method, 
M. R. Harrower? developed the multiple 
choice scale which may be administered to 
large groups and scored objectively. In 
her publication Large Scale Rorschach 
Techniques, she has indicated the numer- 
ical values assigned to the several multiple 
choice responses in terms of conventional 
Rorschach categories. For example, all 
human movement responses ( Rorschach’s 
M) ‘carry a weight of “7”; anatomical 
answers with bad form (F—) carry a 
weight of “6,” ete. Studies by Sisk), 
Wingfield?), Blair), and Berg) indi- 
cate that the Harrower Multiple Choice 
test has been used with varving degrees 


of success in the military, public schools, 
and colleges. 

In a preliminary report’? in 1948, the 
present writers found statistically signifi- 
cant differences between college achievers 
and non-achievers on the Multiple Choice 
Rorschach. 

In the study reported here an attempt 
is made to determine the usefulness of 
the Multiple Choice Rorschach in predict- 
ing the scholastic success of college fresh- 
men. More specifically, we propose to de- 
termine: (1) which among six types of 
weighted multiple-choice Rorschach re- 
sponses vields highest predictions of col- 
lege marks; (2) to what extent do the 
six methods of weighting multiple-choice 
Rorschach responses compare favorably 
with ACE scores in predicting college 
marks; (3) which among the 300 possible 
multiple-choice responses are most closely 
related to academic success; (4) what is 
the optimum combination of ACE scores 
and the several types of weighted Ror- 
schach responses for predicting college 
marks; (5) how consistently do the 
weighted Rorschach responses predict 


academic success in successive quarters. 


PROCEDURE 


In September, 1948, the Harrower 
Multiple Choice Rorschach was admin- 
istered to 504 University of Georgia 
freshmen as part of the battery of place- 
ment tests. The three and a quarter by 
four-inch lantern slides of the Rorschach 
plates were exposed for three minutes. 
Standard procedure outlined in Harrow- 
er’s manual was followed in administer- 
ing the test. At the end of the fall and 
winter quarters, course marks were ob- 
tained from the Registrar’s Office and 
ranked on a nine-point scale. Average 
marks, personal data, and the identifying 
numbers of the response chosen in each 
of the 30 Harrower groups were coded 
and punched on Hollerith cards. Bi-serial 
correlation coefficients were computed be- 
tween each of the 300 responses and aver- 
age fall quarter marks. Responses were 
then weighted according to magnitude and 
reliability of the bi-serial correlation co- 
efficient. Those responses not vielding 
an r significant at the 5 per cent level of 
confidence were disregarded. All signifi- 


2 
| 4 


PREDICTION OF ACADEMIC SUCCESS 25 


cant r’s between + .10 and 19 were 
assigned a weight of + 1; r’s between 
+ .20 and + .29 were assigned a weight 
of + 2; 1r’s between + .30 and + .39 were 
assigned a weight of + 3. The one r of 
—.43 was assigned a weight of —.4. 

Making use of the plus and minus 
weights thus obtained, the present authors 
derived the four following types of 
weighted Rorschach scores (hereinafter 
called GOS scores to distinguish them 
from Harrower weighted scores ) : 


1. GOS total weights (7.¢., the algebraic 
sum of all plus and minus weights 
151 responses out of 300 reliably cor- 
related, either positively or negatively, 
with college marks ). 

GOS plus weights (7.¢., the sum of all 
the plus weights—75 responses posi- 
tively correlated with college marks ). 
GOS minus weights (7.¢., the sum of 
all minus weights—76 responses nega- 
tively related to college marks ). 
GOS “2, 3, and 4” weights (1.e., the 
algebraic sum of weights earned on the 
54 Harrower responses listed in Table 
2), 

The variable entitled Harrower IV eights 
consisted of the sum of the weights earned 
according to the scheme of weighting indi- 
cated in Harrower’s manual. The variable 
entitled Harrower “Good” Responses con- 
sisted of the total number of responses 
which are weighted from “1” through “5,” 
called by Harrower “good.” 

The additional statistical procedures 
consisted of the calculation of various 
zero-order, partial and multiple coeffi- 
cients of correlation. 


RESULTS 
Since space limitations preclude de- 
tailed analyses of all the data, we shall 


Tarte 1. Zero-order 


lartables 


1. Fall quarter marks 
ACE total score 
GOS total weights 


Harrower weights 

GOS plus weights 

GOS minus weights 

GOS “2, 3 and 4” weights 
Harrower “good” responses 


tint wily 


only attempt to make summary general- 
izations concerning the five following 
questions implied by the objectives stated 
above. 


Which of the six methods of weighting 
Rorschach responses yields highest  pre- 
dictions of college marks? 

Table 1 reports zero-order inter-corre- 
lations (Pearson r) among each of the 
eight variables used in the study. Three 
major generalizations are to be noted: (1) 
each of the four GOS methods of weight- 
ing Rorschach responses is superior to 
both of the Harrower methods of weight- 
ing in predicting college marks; (2) as 
among the four GOS methods of weight- 
ing, the method which disregards -+- 1 and 
—1 weights is a slightly better predictor 
of average quarter marks, as well as being 
simpler to apply; (3) as between the two 
Harrower methods of weighting, the num- 
ber of “good” responses is superior to the 
summation of her weighted scores. 


To what extent do the six methods of 
weighting multiple-choice Rorschach re- 
sponses compare favorably with ACE 
scores in predicting college marks? 

Two types of analyses are pertinent to 
the above question. The zero-order cor- 
relations shown in Table 1 indicate that 
ACK. scores are somewhat more predic- 
tive of college marks than are the four 
types of GOS scores and they are mark- 
edly more predictive of such success than 
are either of the Harrower scores. Analy- 
ses based on coefficients of partial corre 
lation reveal that when ACE is held con 
stant, each of the four types of GOS meth- 
ods tend to show an appreciable relation- 
ship to college marks, whereas both types 
of Harrower methods show negligible re- 


correlations among selected variables 


lariables 


| 
; 

2 3 5 6 7 & 

46 21 44 42 47 26 

47 —.31 45 —42 A2 33 
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TABLE 2. Multiple-choice Rorschach responses significantly related to academic success 


Card, group and GOS — Harrower 
response No. Response weights weights 


A dirty mess 

Part ot my body 

Tiny boxing gloves 

A Halloween mask 
Nothing at all 

A white top 

Red and black ink 

A white lamp 

Red and black splotches 
Black and red paint 
Blood and dirt 
Alphonse and Gaston—"“after you”. . 
A bloody stomach 

A giant in a fur coat 

A little flower on the top 
Clouds 

A bat 

TWO little snakes 
Nothing at all 

Sugar tongs 

Smoke 

A man’s face 

Two men with arms folded 
Legs 

Two kings’ heads 

An x-ray picture 

The spinal column 

sceptre 

An x-ray of the spine 

A leaf 

A table leg 

A little man 

Parts of the body 
Nothing at all 

Lambs’ tails 

An x-ray picture 

The lower part of the body 
A white lamp 

Two blue cushions 
Frogs’ heads 

Just spilt paint 

A pink jacket 

Two gnomes 

A. violin 

Messy colors 

An x-ray picture 

Just colored ink spots 
Parts of my insides 

A colored map of California 
Two little dogs sitting up 
A medical picture 

\ design for wallpaper 
A blue flower 

Bones 
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lationships to college marks. Stated some- Which among the 300 possible multiple- 
what differently, each of the GOS scores choice responses are most closely related 
has considerably greater independence of | f@ academic success? 

the intellectual factors measured by ACE Only 151 of the 300 possible responses 
than does either of the Harrower scores. were reliably related to college marks. Of 
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I | 
I 6 
I 4 
I 3 
I 10 
II 5 
II 9 
II 5 
II 9 
Il 9 
Ill 3 9 
Ill 3 1 
Il I 3 
IV 2 
IV 2 
I\ 22 +2 
I\ —.26 —2, 
I\ 22 42 
i \ —.43 —4 1 
\ 26 +2 
\ an +3 
\ +2 
24 2 
i? 
—.28 
20 
6 25 
0 —.24 
\ 29 
\ —,24 
—.24 
) .28 
\ 27 
VIIE C- 22 
IX A- —,25 
IX B- 20 
Ig b- 30 
Im C-9 3l 
| o —.28 
\ 30 
A —,.27 
\ —.33 
\ | 
B 30 
B —.31 
B-6 20 
C-1 F | 
C-7 35 


PREDICTION OF ACADEMIC SUCCESS 


these 151 responses, 54 yielded coefficients 
of + .20 or greater. These 54 responses 
with their corresponding bi-serial coeffi- 
cients, GOS weights, and Harrower 
weights are shown in Table 2. In gen- 
eral, there is a fairly high agreement be- 
tween the GOS and Harrower weights 
shown (r = —.60). Interestingly enough, 
the single response which had the high- 
est predictive value of any was the “noth- 
ing at all” response to card five (—.43), 
for which card few rejections are found 
among normal subjects. 


What is the optimum combination of 
ACE scores and the several types of 
weighted Rorschach responses for predict- 
ing college marks? 

Table 3 shows eight coefficients of 
multiple correlation having to do with 
various combinations of scores as predic- 
tors of college marks. These multiple r’s 
appear to warrant the following gener- 
alizations: (1) each of the four types of 
GOS scores when combined with ACE 
scores vield appreciably higher predic- 
tions of college marks than do ACE scores 
taken singly; (2) the addition of each of 
the four GOS weights to ACE scores in- 
creases prediction in a greater amount 
than does the corresponding addition of 
either of the Harrower weights; (3) ACE 
scores combined with GOS “2, 3, and 4” 
weights give higher predictions than any 
of the other combinations based on any 
two independent variables. 


How consistently do the GOS weights 
predict academic success in’ successive 
quarters? 


The reader will understand that the 
method by which the GOS weights were 
derived was such as to yield the highest 
possible predictions of achievement for the 
students comprising the standardization 
group during the quarter in which the 
data for standardization were collected. 
Under these circumstances it was consid- 
ered advisable to apply the original GOS 
weights (based on fall quarter marks) to 
the same group of students in the winter 
quarter. The r between GOS “2, 3, and 
4” weights and weighted winter quarter 
marks was .43 as compared with a cor- 
responding r of .47 for the fall quarter 
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3. Coefficients of multiple correlation 
among selected variables 


Variables* Coe ficient 


* The several variables involved are the same 
and are identified by the same numbers as those 
listed in Table 1 


(See Table 1). This slight reduction in 
predictive significance of the GOS “2, 3, 
and +” weights is less than the loss in 
predictive significance of the ACE for the 
same periods (winter, .50; fall, 56). A 
new multiple r in which winter quarter 
marks are predicted from ACE and GOS 
weights was found to be .55 as compared 
with the corresponding multiple r of .62 
for the fall quarter, ' 
The above data would, therefore, seem 
to indicate that the predictive significance 
of GOS weights tends to be highly con- 
sistent from one quarter to another, 


SUMMARY AND CONCLUSIONS 


The present investigation grew out of 
the assumption that personality charac- 
teristics other than those measured by 
scholastic aptitude tests are significantly 
related to academic success. More speciti- 
cally, we proposed to determine whether 
or not some preliminary system of 
weighted scores for the multiple-choice 
Rorschach would provide guidance work- 
ers with practical means of improving 
their predictions of academic success. The 
present exploratory investigation —indi- 
cates several types of weighted Rorschach 
responses which, when combined with 
scholastic aptitude test scores, yield ap- 
preciably better predictions of college 
marks than those based solely on scholas- 
tic aptitude tests. The writers have pro- 
jected additional studies designed to de- 
vise a system of weighted Rorschach 
scores which they hope may have even 
higher predictive significance for aca- 
demic success than do the procedures 
herein reported. 
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RORSCHACH CHARACTERISTICS OF DUODENAL ULCER PATIENTS 


R. TRAVIS OSBORNE AND WILMA B. SANDERS 


University 


INTRODUCTION 


10 


Today many: + 11 12) clinicians use the 
term psychosomatic without hesitation in 
connection with peptic ulcer, “for even the 
most organically-minded physician rec- 
ognizes the importance of emotional fac- 
tors in ulcer cases”), That is not to 
say that all peptic ulcers are the final 
organic result of a psychogenic functional 
disturbance but it has been suggested that 
determining the personality traits that 
are typical of the peptic ulcer patient 
might be a valuable aid in making the 
diagnosis of peptic 

The association of the emotions with 
gastro-intestinal disorders has long been 
recognized by such authorities as \lex- 
ander, Draper, Dunbar, and Cushing but 
only a few have recognized that personal- 
ity studies are just as important in the 
diagnosis of functional illnesses as are 
laboratory tindings™!). 

In 1946, Moses*’ reported a psycho- 
dynamic and encephalographic study of 25 


patients. His findings suggested a con- 


of Georgia 


sistent ulcer personality constellation 
characterizeds by marked feelings of inse- 
curity with strong passive traits. 

Glatzel), reporting on the causes of 
peptic ulcer, said that the ulcer personality 
exhibits sensitivity, irritability, strong 
will to work, to creativeness, and to rec- 
ognition. He concludes that these patients 
suffer from non-recognition, non-appre- 
ciation, and threat to security. 

Rush found incidence of peptic ul- 
cer unrelated to scores on the Army Clas- 
sification Test. 

In the present report, ulcer patients are 
studied by means of the Rorschach meth- 
od. 


POPULATION 


The subjects included in this study were 
15 white, male veterans of World War 
IL who, at the time of the examination 
(1948), were receiving compensation for 


service-incurred disability. In 13 > cases 
the disability was diagnosed as duodenal 
ulcer. In two cases the patients claimed 
ulcer condition, but the medical rating 


258 | 
? 
9, 
J. 
4. 10. 
> 
it. 
12. 
6. 
7. 
] 


RORSCHACH CHARACTERISTICS 259 


Taps_e 1. Group averages, ratios, and per cents of Rorschach scoring categories in fifteen duo- 
denal ulcer patients 


Scoring 
Category 


Average initial response time 2 
Chromatic cards 2 
Achromatic cards 


diagnosed the disabilities as functional 
gastro-intestinal disorder gastric 
neurosis. 

The subjects had applied for training 
under Public Law 16, 78th Congress. At 
the time of the examination, they had just 
completed the advisement and guidance 
procedure in connection with their voca- 
tional rehabilitation. 

The age range of the group was from 
22 to 41 with a mean of 29.4 vears. Few 
of the group had any senior high school 
experience. The occupational range was 
somewhat limited, with most of the group 
claiming agricultural, skilled, or semi- 
skilled pre-service experience. Eleven of 
the group were married, three were single, 
and one was divorced. 


PROCEDURE 


After hearing the regulations of the 
Veterans Administration governing such 
studies, all of the subjects agreed to take 
the Rorschach Test. The records were 
taken by three examiners. Each exam- 
iner independently scored each record ; 
where differences in scoring were found, 
the examiners re-scored the records to- 
gether. There was agreement among the 
examiners as to the final scoring in all 
Cases. 

The Wechsler-Bellevue Scale of Adult 
Intelligence was administered to 13 of the 
15 subjects. Two of the group were 
given other intelligence tests. These ex- 
aminations were given, as indicated, as 
part of the advisement and guidance pro- 
cedure. The mean full scale IQ of the 
group was 93; there were no other signifi- 


: Sum C’ + Sum ec 
Sum C’ + Sume 
VIIT + IX 


Average time per response 41” 
Chromatic cards 40” 
Achromatic cards 42” 


cant findings from pattern analyses of the 
Wechsler-Bellevue Scales. 


RESULTS 


From the data presented in Tables 1 
aud 2, the following Rorschach features 
are noted: 


Number of responses. The number of 
responses given by a subject is seldom 
diagnostic but in this study the general 
brevity of the record should be noted. 
The number of responses ranged from 
9 to 61 with only two records of more 
than 25 responses. The average num- 
ber of responses per record is 19. De- 
creased productivity is not unusual in 
records of subjects of limited intelligence, 
but it might be suggestive of neurotic 
blocking when considered with other 
Rorschach’ factors. 


Vanner of approach. In their approach 
to the cards the subjects over stressed 
inferior whole and rare detail responses 
at the expense of obvious details. This 
manner of approach would seem to point 
to individuals who avoiding real- 
life problems by a superficial solution of 
basic issues or by over-concern with 
minutia. These individuals behave much 
as the child who ts unable to distinguish 
between the essential and the non-essen- 
tial and is easily distracted™?. 


Rejections. Vight subjects in the present 
study rejected at least one card. The 
original response to Card IV by a ninth 
subject was denied in the inquiry. This 
high proportion of rejections 1s more of a 


| | No. Av, % Rorschach relationships 
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Tasie 2. Signs of Neurosis present in the Rorschach protocols of fifteen duodenal ulcer patients 


Signs of neurosis JA WA JB RB* WB JF HF GG GH EH WK HL WM ES* Fi 


Color or shading 


Suggestive content . 
Total signs of 
neurosis 7 8 4 7 


x 


5 7 


At time of discharge diagnosis was functional gastro-intestinal disorder. Patient now claims 
ulcer condition. 


Note: + Indicates presence of this sign in the record of the patient. 


neurotic than psychotic reaction in that reaction, clear-cut evidences of color 
nine of the 11 rejections were to Cards II, | shock were present in 10 of the 15 records 
IV, VI, and IX. These cards are fre- studied. Thus, it is seen from their re- 
quently rejected by many so-called normal — sponses that some members of this group 
subjects so these rejections are less sig- of ulcer patients are likely to respond to 
nificant than would be expected at first life situations as the infant would who 
glance’. does what he pleases without regard for 
time or place ; while others, showing some- 
what more control, behave as the child 
who has just become conscious of the out- 
side world. He still must be the center 
of reference but, most of all, he must have 
love and affection™?. 


Human movement. Numerous human 
movement responses of good quality are 
not expected in the records of individuals 
of modest intellectual ability. Only three 
of the 15 records studied had as many as 
two M responses. In eight records M was 
absent altogether. Seven of the 13 hu- Ratio of Animal Movement to Himan 
mans seen in motion were seen on Card Movement Responses. The usual inter- 
111. One other response was an M in pretation of the FM response is that it rep- 
a human detail. These “cheap” and in- resents primitive instincts and drives. In 
ferior human movement responses, com- the child these responses frequently out- 
bined with a W : M ratio of suggest number the human movement responses. 
unrealistic ambition and drive which are For this to continue into adult life is an 
far beyond the subject’s creative ability. indication of immaturity. Such individuals 
cannot accept adult responsibilities and 
are unable to identify with other adults. 
They refuse to give up their childhood 
patterns“: ©), In 14 of the 15 records 
studied, FM responses were equal to or 
greater than M_ responses. 


Color. The use of color by this group of 
ulcer patients was revealing. Five sub- 
jects avoided color responses in any form. 
These subjects further manifested their 
difficulty in handling the colored cards by 
requiring a significantly greater initial re- 
sponse time for these cards than for the Per cent of form responses. The usuai 
achromatic cards. Other subjects who record has from 20 to 50 per cent form 
used color did so in the characteristic responses. .\ greater emphasis on this 
neurotic pattern, CF greater than FC. Six determinant indicates constriction and 
of the subjects used color with little regard rigidity in daily life). These individuais 
for form. Pure color, color naming, and are over-conscientious, meticulous, care- 
CF— responses outweighed the good FC — ful, painstaking people who must do the 
responses. By the usual criteria for this correct and conventional thing. They 


+ + + 

+ + 
shock ...........% + + + + + + . + + 
FM=M.........% ¢ F + . + + 
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never stray from the straight and narrow 
path. Seven of the 15 patients had form 
responses in excess of 50 per cent. 


Per cent of animal responses. Animal re- 
sponses are most comm i in the records 
of children, mental defectives, and neu- 
rotics”’. It is felt that immaturity ac- 
counts for the high A% in the first two 
groups. For the neurotic, the animal re- 
sponse is acceptable and safe. It involves 
no emotional implication. [It is another 
indication of the neurotic’s inadequacy to 
deal with common adult problems. In the 
group studied, seven of the 15 subjects 
had A% greater than 50, 


Neurotic content. Content suggestive of 
neurosis such as blood, fire, and anatomy 
was found in the records of 11 of the 15 
subjects. 


Form-color responses. Usually two or 
more form-color responses are found in 
the records of well-adjusted, socially ac- 
ceptable, mature adults. The FC re- 
sponse in general is interpreted to repre- 
sent “that emotional instability biological- 


Iv necessary and basic for the ability to 
achieve emotional rapport and to make 


emotional approaches to the  environ- 
ment’), Where the form-color 
sponse is absent, poorly seen, or out of 
proportion with the CF and C responses, 
it reflects the subject’s immaturity and his 
inability to meet such personal needs as 
love, protection, affection, and independ- 
ence. These individuals find it difficult 
if not impossible to establish and maintain 
emotional rapport with other persons. 
Twelve of the 15 records in the present 
study had fewer than two FC responses. 


Additional observations based on the 
individual Rorschach records reveal a 
characteristic neurotic pattern with hys- 
terical manifestations. The typically con- 
stricted and inhibited protocol of the hys- 
teric is found frequently among the rec- 
ords of the 15 ulcer patients. Through 
the mechanism of repression, the subjects 
attempt to handle the anxiety stimulated 
by shading and color cards. 

The subjects’ low-average intellectual 
level suggested by the Wechsler-Bellevue 
Scale was confirmed by the usual Ror- 
schach criteria. There are indications of 
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a high degree of stereotypy with little or 
no evidence of the capacity for originality 
or creative thinking. 

Contrary to possible expectations, there 
is no evidence of pre-occupation or over- 
concern with bodily functions, sex, anat- 
omy, or health. The usual Rorschach 
criteria of hypochondriacal tendencies are 
absent. 


SUMMARY AND CONCLUSIONS 


The Rorschach records of 15 white, 
male patients suffering irom duodenal 
ulcer were discussed in terms of conven- 
tional Rorschach features. 

The information obtained from the per- 
sonal history and the results of other tests 
indicated that the group studied was of 
low-average mental ability with an edu- 
cational level in keeping with the op- 
portunities offered by southern rural 
areas. 

In spite of the small number of subjects 
limiting the statistical significance of data, 
it is interesting to note that several fairly 
clear-cut’) Rorschach patterns are dis- 
cernible. The typical patient in the group 
studied is characterized by emotional im- 
maturity reflected in his impulsive and in- 
stant response to feelings. Demands tor 
food, love, attention, and protection must 
be satisfied immediately. The primitive 
instincts of the child are in control. 

The subjects seem to behave on the 
emotional level as children, while intel- 
lectually showing strong seli-assertive and 
ambitious tendencies suggesting unrealis 
tic ambition and drive which are far be 
yond the subjects’ creative abilities. 
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A CONSIDERATION OF FACTOR LOADINGS ON THE SZONDI TEST* 


WILSON H. GUERTIN 


Michigan State College 


INTRODUCTION 

The introduction of any diagnostic tech- 
nique raises the question of its value. 
direct study of validity is desirable but 
rather impracticable when the validating 
criteria are inaccurate and difficult to 
translate into terms similar to those of the 
test result. Rorschach studies well illus- 
trate these difficulties in accurately vali- 
dating test results against psychiatric diag- 
noses. 

Obviously, the fate of a new projective 
technique should not be determined by the 
practicality of a direct validation study. 
Studies directed at molecular aspects of 
Rorschach, when taken singly, do not con- 
stitute validations. Yet, when all such 
studies are considered collectively, one 
is forced to the conclusion that the Ror- 
schach ts a valuable diagnostic instrument. 
These molecular attacks often suggest 
methodological changes which will im- 
prove predictability, or to state it in a 
more general sense, further our under- 
standing of the technique being consid- 
ered. 

Szondi investigations probably should 
be guided by a consideration of our re- 
search experiences with Rorschach, since 
the validation problems are so_ similar. 
Future research directed toward refine- 
ments in technique would seem to be the 
most profitable approach. This view- 

*Szondi material collected by Psychological 
Laboratories of Lincoln State School and 
Colony, Wilham W. Fox, M.D., Superintendent, 
and William Sloan, Supervising Psychologist. 


point is that of Rabin whose studies“: >? 
have rather broad implications for the gen- 
eral technique as well as for Szondi’s 
stimulus pictures. 

In an earlier study’) the writer re- 
ported an investigation of one aspect of 
Szondi need-system theory. Weaknesses 
in this need-system theory were demon- 
strated and it was concluded that, “Szondi 
need-system variables can not be consid- 
ered adequate for explaining all test be- 
havior.” But, “Utilization of the concept 
of need-system seems to be a justifiable 
and desirable approach.” This latter 
statement did not follow from the results 
of the investigation and the present study 
was begun since experimental evidence for 
this contention was lacking in the liter- 
ature. Once again the concept of need- 
systems will be scrutinized. Many impli- 
cations of the need-system theory could 
be studied. However, only a few of them, 
which can be verified easily, will be con- 
sidered. 

Before going further it would be well to 
define the concepts of need-system and 
need-tension, .\ need-system is that per- 
sonality variable which underlies a sub- 
ject’s reaction to the pictures of a given 
diagnostic group{>® 2"), Accordingly, 
there are a total of eight different need- 
systems, corresponding to the eight diag- 
nostic groups utilized in the Szondi test. 
Need-tensions are quantifications of these 
need-systems. need-tension may be 
said to exist in the corresponding need- 


{ 


FACTOR LOADINGS 263 


system when a subject chooses pictures 
from a certain diagnostic category with 
a frequency significantly greater than 
chance. For example, repeated selections 
of catatonic pictures is the basis for as- 
serting that a need-tension exists in the 
corresponding need-system. 


STATEMENT OF THE PROBLEM 


Certain implications of the need-system 
theory are to be tested. The independent 
variable will be the evenness of need-ten- 
sions, while the dependent variable will be 
the Szondi picture selections. Two sets 
of Szondi data are to be studied. The 
first, representing uneven need-tensions 
are to be obtained from a group of “nor- 
mals” with the usual personality imbal- 
ances. The second, representing even 
need-tensions (actually zero) are to be 
obtained by chance selection of the Szondi 
pictures. 

The two implications to be verified 
empirically are: 


1. Unevenness of need-tensions produces 

uneven distributions of selections by 
categories (by definition of need-ten- 
sion). Hence, factor loadings should 
be more variable for the chance Szondi 
profiles. 
Unevenness of need-tensions produces 
intra-factor imbalances (differences 
between “likes” and “dislikes’.) This 
follows from the fact that the test is 
so constructed that the subject is 
forced to make a fixed number of 
choices regardless of the state of his 
need-systems. With even need-ten- 
sions (or zero) in all need-systems, 
he would distribute his choices as 
chance, i.e., evenly between likes and 
dislikes within each factor. There- 
fore, loadings of choices in either di- 
rection would have to be explained by 
the converse, uneven need-tensions. 


Inspection of the Szondi data should 
reveal the following : 


1. Loaded reactions greater for subjects. 

2. Open reactions greater for subjects. 

3. Plus choice-reactions greater for sub- 
jects. 


4. Minus choice-reactions greater for 
subjects. 


Ambivalent choice-reactions for 
subjects. 
Intra-factor imbalance greater for 
subjects. 


PROCEDURE 


Fifty-five employees of a state hospital 
provided the Szondi data reflecting uneven 
need-tensions. These subjects, who were 
employed chiefly as attendants, were of 
both sexes and various ages. Their ad- 
justment was “average” but it can be pre- 
sumed that the usual neurotic, schizoid, 
and cycloid imbalances existed as is the 
case with any group of “normals.” The 
Szondi tests were administered to these 
subjects individually in accordance with 
Deri’s explicit instructions“: and the 
data were treated conventionally. 

The other group of Szondi profiles, re- 
flecting even need-tensions, was obtained 
by making the picture selections from a 
random number table). Sixty-eight such 


Szondi profiles were obtained this 


fashion. The actual choice of pictures by 
this method corresponded exactly to the 
procedure used with the subjects ; the only 
difference being that the random number 
table determined the picture selection 
rather than the need-systems of the sub- 
ject. All profiles were based upon one 
administration. 


Taste 1. Scores on the Ssondi for subjects as 
conmepared with chance 


Group 
Scores Subjects  Chanee 

Factor-loadings : 

Per cent loaded 

Per cent open .... 
Choice-reactions 

Per cent plus 

Per cent negative 

Per cent ambivalent 


All tests of significance of differences in 
the two Szondi samples utilized chi- 
squares, which were obtained by employ- 
ing cutting lines at appropriate points on 
the score scales and dealt with the number 
of cases that fell above, and on or below, 
this line. All these chi-squares were 
corrected for continuity’®?. 


6. 
| 

N 440 N = 543 
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TABLE 2, 
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Percentage of cases showing Szondi scores with differential significances. 


Scores 


Group 


(ldf) 
Subjects 


chi-sq.* 


Chance 1. of c. 


Factor-loadings : 
Loaded (> 2) 
Open (> 1) 

Choice-reactions : 

Plus (> 2) 

Negative (> 2) 

Ambivalent (> 1) 


5.5 60.3 0.1 80 


65.5 

69.2 0.9 50 
56.3 55.8 0.0 1.00 
69.0 36.8 10.6 Ol 
20.0 45.6 8.2 1 


N = 68 


although not reported in the table. 


Factor loadings. Table 1 shows that the 
per cent of loaded reactions is approxi- 
mately the same for both subject and 
chance Szondi data. Corresponding levels 
of significance, calculated from the accom- 
panying data, are to be found in Table 2. 
pen reactions are slightly, but not sig- 
nificantly, lower for the subjects. 


Choice-reactions. Vlus_ choice-reactions 
| are approximately the same for both 
the subject and chance Szondi_ profiles. 
Rather unexpectedly, the negative choice- 
reactions, seen in Table 2, show a statis- 
tically significant increase from 28 per 
cent for chance to 37.1 per cent, even 
though a corresponding change was not 
observed for the plus choice-reactions. In 
a complimentary fashion, the ambivalent 
choice-reactions show a. statistically sig- 
nificant decrease from 16.5 per cent for 
chance to 9.3 per cent for the subjects. 


Intra-factor imbalance. Inspection of 
Table 3 discloses differences in the groups 
for intra-factor imbalances (differences 
hetween the number of likes and dislikes 


TABLE 3. 


Imbal. value 


although not reported in the table. 


* Frequencies of non-occurrence were considered in the calculation of chi-square, 


Percentage of cases showing intra-factor imbalance cutting-scores with the 
differential significances 


Cutting line ....... >0) >0 >1 


Group 
Chance (N 544) ... 16.2 36.8 17.6 
Subjects (N 440) .. 3.2 43.7 4§ 
Chi-square* (1 df) .. 00 03 


Frequencies of non-occurrence were considered in the calculation of chi-squares, 


within each factor). The minus imbal- 
ance values indicate a predominance of 
dislikes, and similarly for the plus imbal- 
ances. A comparison of the percentages 
of cases given in Table 3 shows that the 
imbalance is greater for the subjects than 
for chance, since there are fewer of the 
subjects showing more than one balanced 
factor (zero imbalance). The most sig- 
nificant differences between the groups 
appear at imbalance values of —2 and +4, 
5, 6. The chi-squares at these points are 
significant at less than the 1 per cent level 
of contidence. 


Discussion or RESULTS 


In general, these results indicate that 
picture selections are determined, at least 
in part, by the need-tensions of the sub- 
jects. This lends support to the thesis 
that the need-system approach is valuable 
in attempting to understand the reactions 
of the subject to the Szondi test. 

More specifically, two general implica- 
tions of current need-system theory were 
tested. Only one of these is supported by 
the results. It would seem that need-ten- 


456 63.2 500 221 32.3 44 
47.3 45.5 346 27.3 40.0 41.8 
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264 
— 
N=55 
1 0 44 42 
>| >] >1 >0 >0 


FACTOR LOADINGS 265 


sions are best detected by attention to im- 
balances within the factors. When a sub- 
ject has a high need-tension we can ex- 
pect it to be reflected by a marked tend- 
ency to select pictures as either likes or 
dislikes in the corresponding factor, but 
seldom does he select both in an ambiva- 
lent fashion. 

It is seen that the total number of 
choices within the individual factors does 
not correspond closely with high need- 
tensions in the related need-systems. This 
is rather surprising since Deri puts so 
much emphasis on the unevenness of fac- 
tor loadings. Not only is the factor load- 
ing the chief definition of need-tension 
but the initial approach in examining a 
profile for tensions employs examination 
of the factor loadings. In extreme cases 
of uneven factor loading, such as zero or 
six choices, evidence of unusual need-ten- 
sion probably exists. However, the value 
o1 studying slight deviations from the ex- 
pected loading of three choices would ap- 
pear questionable in the light of these re- 
sults. 

In this same vein, reference to Table 1, 
under factor loadings, shows that the com- 
bined loaded and open reactions comprise 
58.1 per cent of the factors in the chance 
profiles. Since these categories of open 
and loaded reactions represent deviations 
from expected loadings they should afford 
interpretive information, but it would ap- 
pear that the categories are too inclusive. 
With such criteria too many chance devia- 
tions will be included. This criticism 
might be obviated to some extent by the 
argument that agreement upon retesting 
establishes these deviations as attributable 
to something other than chance. Still it 
would be necessary to demonstrate that 
this something, which is responsible for 
retest agreement, Szondi  need-sys- 
tems. An earlier investigation by the 
writer'-) makes such a contention very 
questionable. 

\nother interesting aspect of this study 
is the marked tendency for need-tensions 
to be expressed in the negative choice-re- 
actions. It would appear that many valu- 
able diagnostic clues, as to existing need- 
tensions, exist among the subject's nega- 
tive choice-reactions. The tendency for 
subjects with unbalanced need-tensions to 


show a greater number of these negative 
choice-reactions probably occurs at the 
expense of the ambivalent choice-reactions, 
which might conceivably vary concomit- 
antly. Deri is probably correct when she 
considers ambivalent choice-reactions as 
indicators of stability, but there is little 
support for the belief that they represent 
a state of conflict, if the factor loading ts 
near expectancy’! 5°), 

Finally, it might be mentioned that a 
group of schizophrenics and another of 
college students gave similar Szondi data 
to those employed in this study. The 
writer is indebted to Dr. Albert 1. Rabin 
for providing the Szondi profiles of these 
supplementary populations. 


SUMMARY AND CONCLUSIONS 


1. A consideration of the need-system 
rationale for explaining Szondi test per- 
formance sets forth two theoretical imph- 
cations to be verified. a. Uneven need- 
tensions will produce uneven factor-load- 
ings. b. Uneven need-tensions wall pro- 
duce imbalances between “likes” and “dis 
likes” within the individual factors. 

2. Szondi data from a group of 55 
“normals” were obtained, and supposedly 
reflect’ the uneven need-tensions asso- 
ciated with the usual personalities found 
in such a group. Szondi data reflecting 
even need-tensions were obtained by mak- 
ing picture selections by chance from a 
random number table. 

3. statistically significant ditfer- 
ences in the factor-loadings between these 
two groups were observed. Hence, the 
conventional approach of scanning factor 
loadings tor signs of unusual need-ten- 
sions would not appear to be very useful. 

4. Negative choice-reactions were sig- 
nificantly higher for the subjects’ than for 
the chance profiles. This increase seemed 
to occur at the expense of ambivalent 
choice-reactions. Therefore, would 
seem most profitable to look for signs of 
need-tensions among the negative choice- 
reactions and to consider the ambivalent 
as indicators of normal need-tensions 

5. Imbalances within the factors were 
significantly greater for the subjects, and 
it is inferred that high need-tenstons are 
usually reflected by the tendency to select 


q 
| 
i 


266 M. A. 


pictures as either likes or dislikes but not 
both within the same factor. 

6. The open and loaded factor-load- 
ings, representing deviations from expect- 
ancy, occur very frequently by chance 
alone (58 per cent of the time). The 
criteria for these loadings seem to be too 
inclusive to indicate significant deviations 
from expectancy. 


7. In general, the results lend support 
to the belief that the need-system rationale 
is valuable in understanding the test be- 
havior of the subject, but certain changes 
in the analytical approach to Szondi pro- 
files seem to be indicated. 


BROWN 
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ALCOHOLIC PROFILES ON THE MINNESOTA MULTIPHASIC 


M. A. BROWN 


Mendota State Hospital 


INTRODUCTION 


Within recent years increased admis- 
sions of chronic alcoholics to hospitals 
have stimulated concern and interest in 
this problem. It is apparent that investi- 
gators have given up “the quest for the 
alcoholic personality”), however, most 
of the reported studies have been con- 
cerned with attempts to describe etiolog- 
ical factors or group personality character- 
istics from case history material: ”, 
Experimental studies are few in number 
and consist largely of delineation of per- 
sonality factors by means of test tech- 
niques, such as the Rorschach": 2), and 
the Thematic Apperception Test). Sur- 
vey of the literature indicates that,there is 
little which is directly applicable to the 
present. study which primarily con- 
cerned with the use of a psychometric 
instrument differentiating alcoholic 
groups with the hypothesis that it may 
provide a practical means of selecting and 
predicting the outcome of treatment. The 
need for such a screening device is ap- 
parent in hospital populations where alco- 
holics are present in large numbers and 


the selection of the most effective treat- 
ment for the imdividual patient presents 
difficulties that often result in no treat- 
ment at all. ‘ 


PROBLEM 


In the routine testing of alcoholic pa- 
tients, it was noted that MMU protiles 
could be grouped with relative ease into 
those showing primarily neurotic and psy- 
chopathic patterns, respectively. It was 
felt that if this differentiation could be 
made etticiently, some insight into the per- 
sonality problems involved, as well as a 
tool for predicting the efficacy of treatment 
might be provided. In hypothesis, alco- 
holics who manifest neurotic patterns 
might be more amenable to therapeutic 
measures than those who show patterns 
indicating psychopathic problems. Specu- 
lating further, the neurotic drinker may 
he more likely to respond to such sup- 
portive group measures as that offered by 
AMleoholics Anonymous, which involves 
largely interdependency and religious 
conversion. ‘The purpose of the present 
study is an attempt to differentiate the 
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profiles of 80 alcoholic patients, by means 
of pattern analysis, into those showing 
psychopathic and neurotic trends. 


Subjects. These were 120 hospitalized 
male patients, whose psychiatric classi- 
fications were as follows: Without Psy- 
chosis, Chronic Alcoholism, 80; Without 
Psychosis, Psychopathic Personality, 20; 
Without Psychosis, Psychoneurosis, 20. 
These patients were consecutively ad- 
mitted to the Elgin State Hospital, and 
had not been hospitalized on more than 
one previous occasion. The mean number 
of admissions for the alcoholic group was 
1.2. The neurotics had no previous ad- 
missions, and the psychopathic group 
averaged 1.1 admissions. The mean ages 
for the groups were: Alcoholics, 35 years ; 
Neurotics, 30.3 years ; Psychopaths, 28.05 
years. 


Method. The MMPI was administered 
to all the alcoholic subjects as part of a 
routine test battery, In selecting the neu- 
rotic and psychopathic groups, in which 
alcoholism was not a factor, only the 
MMPI was administered in some cases. 
The 80 profiles of the alcoholic group 
were. then sorted by the author, and 
by two independent raters’ into the 
CAN (Chronic Alcoholic, Neurotic) and 
CAP (Chronic Alcoholic, Psychopathic ) 
groups. The sorters were instructed to 
place each record, according to profile 
into one of the two categories. In the 
case of indecision a Cannot Say category 
was utilized. 
RESULTS 

Only those records on which total 
agreement was obtained were used for 
comparative purposes. All records were 
sorted into the two categories by two rat- 
ers. The remaining rater placed 13 rec- 
ords in the Cannot Say category. Inves- 
tigation of the sortings of all three raters 
indicated that all of the 13 cases thus 
placed by one rater, were classified as neu- 
rotic by the others. These, therefore, for 
simplifving the handling of data, were in- 
cluded in the group of total agreement. 
The final group consists of 67 cases: 34 
CAN and 33 CAP. The difficulty of dis- 

1. I wish to thank Dr. Abraham Carp and 
Dr. Lewis FE. Drake for sorting the records in 
this study 


tinguishing such records is not uncom- 
mon, since in non-psychotic profiles, psy- 
chopaths tend to show more obvious pat- 
terns and frequently produce single-peak 
profiles. Neurotics, however, often show 
“normal” records with little variation 
around the T score of 50, as well as un- 
elevated validity scores. The 13 records 
showing disagreement among raters were 
rejected, although total disagreement did 
not occur on any of them. Chi squares 
for the sortings of the three raters are 
given in Table 1. The validity scores 


Taste 1. Comparison of the sortings of three 


judges by chi square 


Judges 


23.62 OO} 


2 and 3 0] 


1 and 3 5.92 AT 


were not significantly elevated in any of 
the groups, and consequently are not re- 
ported as a means of comparison, though 
the lL. score was slightly elevated in five 
of the neurotic records, and may have 
been used as an indicator by the raters. 
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Fic 1. Elevations in percent on MMPT profiles 
for CAN and CAP groups 


\ triadic pattern of recording high 
scores on each record enabled pattern 
comparison by frequency of elevation. 
This consisted of the three highest scores 


| 
L 
A : 
‘ 
1 \ 
\ 
: 
= | 
| \ / 
}/ \ / 
\ 
/ F 


268 


on each profile, which were used because 
pattern-analysis is ordinarily based on this 
procedure, and low scores, as yet, are of 
no known importance. These frequencies 
were then converted into percentages for 
graphic presentation. Chi square was 
used for purposes of frequency compari- 
son. 

Division of the alcoholic group, de- 
picted by frequency of elevation in terms 
of per cent, seen in Fig. 1, shows two 
markedly diserepant characteristics: a 
greater proportion of elevation on D in 
the CAN group, and more frequent eleva- 
tions of Pd in the CAP group. Chi square 
here is 8.56, with a P of .O1-02, indicating 
that the differences are minimally due to 
chance factors. The psychopathic and 
psychoneurotic groups (Fig. 2) are widely 


D Hy Pa Ms Ps Pe Sc Ma 
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Nevrotics « 


Psychopaths ——- — — — — 


F 2. 


Elevations in per cent on MMPI pro- 
files 


for neurotic and psychopathic groups. 


divergent in pattern, showing marked dis- 
crepancies on D, Pd, and Ma, with the 
psychopaths exhibiting marked elevations 
on Pd and Ma, while the neurotics show 
their most frequent elevation on D. Chi 
square here is 7.058, with a P at the .02 
level. Plotting the frequency elevations 
of the CAN and neurotic groups, it is seen 
that the neurotic alcoholic shows greater 
similarity to the neurotic who does not 
drink than to the remainder of the al- 
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Fic. 3. Elevations in per cent on MMPI pro- 
files for CAN and PN groups. 


coholic group. The entire pattern of the 
profile of high scores is concentrated at 
the non-psychotic end of the scale, while 
psychotic scores are low. Convergence of 
frequency is noted on the D scale where 
71 per cent of the CAN group and 75 per 
cent of the neurotic group show primary 
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Fic. 4. Elevations in per cent on MMPI pro- 
tiles for CAP and PP groups. 
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elevations. Discrepancies are apparent 
on the Hy scale and Mf. Other than the 
general trend of pattern, these differences 
must be interpreted with caution because 
of the small number of cases in the neu- 
rotic group. Chi square is 10.11, and P 
is .O1. The patterns of elevation are seen 
in Fig. 3. Comparison of the CAP 
group and the psychopaths indicates great- 
er similarity between the alcoholic group 
and the non-aleoholic psychopaths than 
between the alcoholic group and_ the 
CANs. A marked discrepancy is seen be- 
tween the CAP and CAN groups, as 
noted previously, but the CAP and psy- 
chopathic groups show striking similarity 
of pattern, with most frequent elevations 
on the Pd and Ma seales. Chi square is 
9.23, significant at the .O1 level. 


SUMMARY 


The chronic alcoholic group as a whole 
does not show a typical pattern which is 
readily discernible from other groups. 
However, when differentiated into those 
showing primarily neurotic and psycho- 
pathic patterns, they show striking differ- 


ences within the group, and greater sim- 
ilarity to neurotics and psychopaths who 
do not drink. The neurotic alcoholic is 
apparently more closely related in’ the 
nature of his problems to the non-alcoholic 
neurotic than he is to the alcoholic who 
exhibits the behavior problems repre- 
sented by a psychopathic pattern. 

Since it is generally accepted that the 


neurotic is more easily reached by ther- 
apy, it may be speculated that this group 
of alcoholics would be more likely to re- 
spond successfully to treatment, particu- 
larly to psycho-therapeutic measures, than 
would be the psychopathic group, in which 
treatment usually produces only super- 
ficial and transient improvement. Predic- 
tion of the outcome of treatment by means 
of this technique is dependent upon fur- 
ther research. 
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WECHSLER-BELLEVUE CHANGES FOLLOWING PREFRONTAL 
LOBOTOMY* 


MILTON W. 


MCCULLOUGH 


Columbus State Hospital 


INTRODUCTION 


The scope of this report is limited to 
the changes in Wechsler-Bellevue ( Form 
1) weighted scores noted in ten postlobo- 
tomy patients out of a total of twenty-one 
patients studied intensively at Longview 
State Hospital, Cincinnati, Ohio during 
the period February to November, 1948. 
Psychological examination was under- 
taken during the preoperative week and 
was repeated during the second and 
eighth postoperative weeks. The total 
test battery included the Wechsler-Belle- 
vue Intelligence Scale, the Rorschach 
test, an Agnosia, Apraxia, Aphasia Se- 
ries, Color Naming, Color Substitution, 
Memory Span for Objects, Picture Simi- 
larities, Proverb Interpretation, a Clini- 
cal Interview and Description, and a Be- 
havior Inventory (a 55-item trait list for 
describing ward behavior). The ten pa- 
tients who vielded scorable Wechsler re- 
sults consisted of six females and = four 
males, ranging in age from 15 to 51, who 
had been psychotic over a range of 9 to 
202 months. Diagnostic categories were 
represented as follows: 3 paranoid schizo- 
phrenics, 1 mentally deficient psvehotic, 2 
catatonic schizophrenics, hebephrenic 
schizophrenics, and 1 schizoaffective psy- 
chotic. The range of school grades com- 
pleted was from 6 to 13. All were pa- 
tients believed to be chronically il with 
poor prognosis, and all had failed to re- 
spond to other therapeutics. 


Metiop 


For purposes of this study it was de- 
cided that three conditions would be ob- 
served, These were: (A) the control or 
preoperative condition; (B) the experi- 
mental | or first postoperative condition ; 
and (C) the experimental Il or second 
postoperative condition, For convenience, 

* This report is based upon a section of Chap- 
ter of a doctoral dissertation “Psychologie 
Changes Following Prefrontal Lobotomy,” by 
the writer, submitted to the Graduate School, 
University of Cincinnati, June 3, 1949, 


these will hereafter be designated as A, 
B, and C conditions respectively, and, in 
the present connection emphasis will be 
placed upon A and C conditions. The 
time interval between these two condi- 
tions was nine to ten weeks. At each 
sitting tests were administered in a given 
order and by the same examiner. 
ReEsuLTs 

In another phase of the present investi- 
gation the Wechsler - Bellevue results 
were analyzed and discussed in terms of 
each individual patient. In the present 
discussion we are concerned with group 
results. Since approximately 50 per cent 
of all the lobotomy patients are omitted 
from the present statistical summary, a 
sampling bias of undetermined magnitude 
is introduced ; quantitative results, there- 
fore, are presented as measured. These 
ten patients do not necessarily constitute 
the most “improved,” but rather they are 
the individuals capable of the sustained 
attention and application requisite to per- 
formance on an “intelligence test.” 

Vable 1 below presents weighted scores 
on the 11 subtests for each patient under 
both A and C conditions. The verbal, 
performance, and full scale intelligence 
quotients as well as the deterioration per- 
centages are included. The means and 
average deviations for each test are en- 
tered in the lower part of the table, and 
below these are to be found t-ratios and 
probabilities of the significance of differ- 
ences between A-condition and C-condi- 
tion means.’ The last row labeled “Aver- 
age Modified Mean Scatter’ contains 
values arrived at by averaging the devia- 
tions in weighted score units of each sub- 
test from the mean of the other subtests 
in its seale (verbal or performance), in 
the computation of which the subtest 
score in question is excluded: 54), 

These results reaffirm the well-known 
finding that the subtests most resistant to 
change are Vocabulary, Information, and 
Similarities. They further support the 
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expectation that general IQ values, as 
measured by the Wechsler, remain stable 
in the postoperative state. Of greatest 
interest is the indicated postoperative im- 
provement of the scores on Digit Span, 
Picture Arrangement, and Block Design 
subtests and the reduction in the mental 
deterioration index percentages. 


1. The following formula adapted for use in 
the present study was suggested by Professor 
Herbert B. Weaver, Department of Psychology, 
University of Cincinnati: 

Significance of the Differences between Means 
When Measures are Related: Computation by 
the Difference Method. 

{ Observations are paired for 
| one of more relevant va- 
Applicable when: riables 
| Each subject is his own 
| control 
Let No = number of pairs of measures 
observed differences between pairs 
2D 
My, = —— = mean of observed differences 
N between pairs mean 
difference, which is equal 
to the difference between 
means) (2D is taken alge- 
braically ) 
= standard deviation of observed dif- 
ferences between pairs 
— standard error of mean of observed 
differences between pairs 


Fe) 


(when M,, 


The Digit Span is considered not as a 
memory test but as an attention test. An 
individual attempting the Digit Span 
mobilizes his energies to meet a challenge 
from outside reality. The degree to which 
he is successful would seem to depend 
upon how much energy is free to be util- 
ized for the task at hand and how much 
is deploved by “internal affects, needs, 
and strivings’’ ef [Tt follows from 
this principle, since lobotomy is almost a 
specific agent in breaking up the self- 
preoccupation and internalization of ener- 
gies of the psychotic, that an improvement 
in the ability to attend would be antici- 
pated. Such an improvement was sug- 
gested in these patients. 

The Picture Arrangement subtest has 
been suggested as a measure of planning 
ability and ability to anticipate: 215), 
One is required to take a series of isolz ited 
pictures and arrange them into a mean- 
ingful (and temporal) sequence. When 
the character (person) in a_ picture is 
found in a given situation, the subject 
must anticipate which of several alterna- 
tive situations would “logically” follow. 
In addition to spatial and temporal se- 
quence relationships we appear to be deal- 
ing with a kind of “social sense” or em- 
pathy, since the subject no doubt identi- 
fies himself with the character an the pic- 
ture (one patient seemed to demonstrate 
this when he said, “Here I pick up the 
girl and walk down the street with her.”’) 
The present results indicate that these pa- 
tients perform significantly better on this 
test. postoperatively, although scores are 
low under both conditions. The question 
arises as to whether these results could be 
inconsistent with the findings of Freeman 
and Watts)? 892) who note in’ their 
postoperative patients defects in the ‘abil- 
ity to foresee, to see before, to forecast re- 
sults of certain activities” and “reduction 
in consecutive thinking.” It is possible, 
however, that the better postoperative 
performance of our patients on the Pic- 
ture Arrangement test is not a function 
of “planning ability” at all, but a mere 
concomitant of some such process as im 
provement in attention and concentration 
abilities. 

The third subtest showing noticeable 
improvement after lobotomy is Block De- 
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sign. This is a visual-motor test involv- 
ing analysis and subsequent synthesis of 
visually perceived geometric — designs. 
Motor retardation, tension, anxiety, and 
visual or spatial-perceptual deterioration 
are some of the processes of probable in- 
fluence in depressing performance on this 
test. In the postlobotomy patients a bet- 
ter performance may be associated with 
release from tension and depressive trends 
afforded by the operation. 

The reduction in Deterioration Per- 
centage for these ten patients after lobo- 
tomy may be accounted for when one re- 
members that this measure is essentially 
a ratio between the Information, Vocabu- 
lary, Picture Completion, and Object As- 
senlly subtests on the one hand and the 
1) Span, Arithmetic, Block Design, 
ai) Digit Symbol subtests on the other. 
‘Tue former ‘group was relatively stable 
during the two administrations, but the 
latter group showed consistent elevation 
of scores. This might suggest the hypo- 
thesis that tensions and self-preoccupation 
processes are as important in the De- 
terioration Percentage as the physiologic 
aging process itself. Recent investiga- 
tions, however, shed doubt upon the de- 
pendability of the Deterioration Index as 
a measure of psychotic functioning (e.g., 


2). In concluding the discussion of Table 
1, we may point out that the Modified 
Mean values indicate greatest negative 
scatter on Picture Arrangement and Digit 
Symbol and greatest positive scatter on 
Object Assembly and Block Design. 
Hence, in group averages the subtests 
most vulnerable to the encroachment of 
psychosis retain their characteristic levels 
in the postoperative period. 


CONCLUSIONS 


Postoperative Wechsler-Bellevue re- 
sults as compared to preoperative results 
in ten prefrontal lobotomy patients re- 
veal : 

1. Strong improvement in the atten- 
tion (Digit Span) and planning ( Picture 
Arrangement ) abilities. 

2. A notable decrease in the Deteriora- 
tion Index Percentages. 

3. An improvement in 
visual - motor coordination 
sign). 

4+. No changes in general verbal ability 
(Vocabulary, Information, and Similari- 
ties). 


reproductive 


(Block De- 
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Results Under Conditions A and C 
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THE PREDICTION OF TEACHER-PUPIL INTERACTION WITH 
A PROJECTIVE TEST 


THERON ALEXANDER, JR. 


Florida State University 


Although psychiatrists, psychologists, 
and educators agree that teachers play an 
important part in the development of the 
personality of children, objective evidence 
to support this view is lacking’). The 
lack of information is partly due to the 
fact that until recent years techniques for 
the investigation of personality were not 
sufficiently developed. This study at- 
tempts to explore the possibility of using 
a projective test which would be of value 
in studying teachers and their inter-per- 
sonal relationships with children. The 
major problem of this study involves pre- 
dicting with a projective test the ways in 
which teachers interact with children as 
revealed by observational data. 


THe DEVELOPMENT OF THE PROJECTIVE 
Test 


It was not thought to be suitable to use 
existing projective tests, because they con- 
tained bizarre stimuli which would make 
plausible reasons for giving the test diff- 
cult to find and they consumed too much 
time. It was believed that a series was 
needed which would include pictures with- 
in the experiences of the teachers—pictures 
about children and adults’ interaction with 
them. <A tentative series of pictures was 
developed and used in a pilot study. The 
results of this study made it possible to 
evaluate the pictures and to discover the 
themas and some characteristics of the 
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self. The series of eight pictures used in 
this pilot study was then used for the 
present study. 

THe Data 


The data for the study were obtained 
in conjunction with a research project.’ 
The Thematic Apperception Test as de- 
veloped for teachers was administered to 
seventy teachers in two groups of approxi- 
mately thirty-five each. A sample of 
twenty-five subjects for this study. was 
selected from the larger group of seventy 
on the basis of age and marital status so 
as to have the sub-group for this study 
fairly representative of the larger group. 
The mean age for this group was forty. 
All grade levels were represented through 
the sixth grade. 

During the school year in which the 
TAT was administered, the staff of the 
research project gathered data on the 
teachérs in their classrooms. The assign- 
ments of the staff were so controlled that 
each subject was visited by a different ob- 
server at a different time. 


Mertriop or ANALYSIS 


In approaching the problem of analysis 
of the TAT records, a number of require- 


ments were evident. A framework for 
organization was needed which would in- 
clude not only certain personality charac- 
teristics, but those characteristics of the 
individual which were significant in deter- 
mining teacher behavior in interaction 
with children. It was thought to be help- 
ful to approach the description of the se/f 
by using three divisions. These main 
parts were designated as the individual's 
Intellectual Capacity, Affective Compo- 
sition, and ldjustment Patterns. The 
framework was developed in collaboration 
with the research project. 

Not only Was it necessary to develop 
this framework, but it was also necessary 
to develop a procedure for treatment of 
the data to reveal information on the 
various categories within the framework. 
This procedure to give the data meaning 
and to organize it under each category of 
the framework was developed in an effort 

1. This project was carried on under the 
Committee on Human Development at the Uni 
versity of Chicago 
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to set forth the precise method of analysis. 
The analysis of the TAT records involved 
both an analysis of the form characteris- 
tics and the content of the stories. For 
each subject a complete analysis was writ- 
ten and organized according to the 
“framework for analysis.” Each analysis 
and prediction was done “blind,” that 1s, 
at this stage of the study the identity of 
the subjects was not known to the writer. 


CATEGORIES OF BEHAVIOR PREDICTED 


For the purposes of this study certain 
categories for prediction were selected in 
order to demonstrate the feasibility of 
using a projective test to predict ways of 
behavior of teachers in interaction with 
children. The list of categories was not 
considered to be complete nor was the 
list believed to include all of the important 
categories of behavior in interaction. The 
seven categories selected were as follows: 
(1) teachers’ acceptance of children’s fun- 
making, horseplay, etc. (Pleasure), (2) 
teachers’ acceptance of sexuality of chil- 
dren (Sexuality), (3) teachers’ accept- 
ance of aggression in children (Aggres- 
sion), (4) teachers” acceptance of depend- 
ency in children (Dependency ), (5) teach- 
ers’ acceptance of non-achievement in chil- 
dren (Non-achievement), (6) teachers’ 
acceptance of disorder in the classroom 
(Disorder), and (7) the offering of af- 
fection to children (Affection ). 

Since six of the categories concerned 
acceptance and the seventh was a similar 
concept, it seemed logical to set up scales 
for each category ranging from little ac- 
ceptance to much acceptance for the six 
and a scale ranging from the offering of 
little to much for the seventh. Each scale 
contained three points. Little acceptance 
was’ designated by one, some acceptance 
was designated by two, and much accept- 
ance was represented by three. These scales 
were designated by a single word title for 
the sake of convenience, though an ade- 
quate one word description is impossible 
and perhaps misleading. Both the projec- 
tive and observational data were rated on 
these scales. 


RESULTS 


The purpose of this study was to ex- 
plore the possibility of predicting some 


= 
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TABLE 1. Discrepancies between obtained and expected frequencies by chance with 


Level of 
significance 


Categories hy chance Obtained Difference x" percent 
8.50 21.00 12.50 18.38 1 
9.75 20.00 10.25 10.78 1 
9.50 18.00 8.50 7.61 | 
10.75 19.00 8.25 6.33 2 
Non-achievement ......... 11.50 20.00 8.50 6.28 2 
21.00 11.25 12.98 1 


of the behavior patterns which teachers 
show in their interaction with children. It 
Was necessary to compare the predictions 
witli the actual behavior of the teachers 
in the classroom. There was an attempt 
to establish validity of the TAT by pre- 
dicting seven items of behavior and com- 
paring these with observations of behavior 
in the classroom. By comparison with 
previous studies involving prediction, 
validity was furthered by using a larger 
population”), 

It was found that for all the (sever) 
categories, 76 per cent of the predictions 
were in agreement with the observational 
data. Only 38 per cent of the predictions 
would be expected by chance to agree with 
the observational ratings”). 

Of the 24 per cent of the predictions 
where there were discrepancies, 22 per 
cent of the predictions differed from the 
observations by one point and 2 per cent 
differed by two points. One would ex- 
pect by chance that out of the total num- 
ber of predictions, 50 per cent should dif- 
fer by one point,on the rating scale and 
that 11 per cent should differ by two 
points. The above applies to the total 
predictions made and includes all of the 
categories. 


Although the agreements between the 
ratings made from the TAT and _ those 
made from the observational data were 
high, additional evidence was sought to 
establish the reliability of the interpreta- 
tions. Accordingly another analyst was 
asked to make ratings on both the TAT 
analyses and observations. It was found 
in comparing the second judge's ratings 
with those of the writer that out of 70 
pairs of ratings, 89 per cent of them were 
in agreement. In a re-rating of five cases 
by the writer, out of seventy pairs of rat- 
ings 95 per cent of them agreed with the 
previous ratings. 


CONCLUSIONS AND IMPLICATIONS 


This study has shown that it is possible 
to predict certain ways of behavior of 
teachers and that these predictions have 
close agreement with the observed be- 
havior in the classroom, Also, in consid- 
eration of the wide range of information 
provided by the analysis of the TAT in 
the areas of mental capacity, emotional 
make-up, and patterns of adjustment, it 
seems to be worthwhile to investigate the 
possibilities for the use of the TAT in 
selection of teachers. At present with the 


Taste 2. Percentage of TAT predictions expected by chance to differ with observa- 
tions on pomts on ratuig scale and the obtained percentage differences 


Expected by chance 


One point 


( ‘ategories 
Pleasure 
Dependency .......... 
Non-achievement 


Obtained 


Two points One pot Two points 


lo 16 
1] 20 
12 28 
y 20 4 
16 4 
13 Ww 4 
1] 16 
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framework and procedure for analysis 
used in this study it is possible to deter- 
mine the people who would be warm and 
affectionate in their relationships with 
children. It is possible to see their aware- 
ness of feeling in other people. The ex- 
tent of their anxiety and concern over 
personal conflicts can be determined. 


FiInpINGs 


This study revealed some aspects of the 
personalities of some teachers in this 
group which should be noted. Among 
these were difficulties in the psychosexual 
area, high levels of anxiety, and an im- 
maturity in affective development. These 
findings were not in the aim of this study, 
but were revealed in the course of the 
TAT analyses. The psychosexual area 
involved conflicts over acceptance of feel- 
ings of sexuality. Anxiety in some cases 
was quite high and was revealed by the 
form characteristics of the stories as well 


GRACE ARTHUR 


as the content. Immaturity was shown 
by the high degree of hostility still held 
for parents and a failure to achieve a suf- 
ficient resolution of these conflicts. Some 
subjects tended toward emotional isola- 
tion. 

On the other hand there were subjects 
who showed superior ability in reasoning 
and creativeness. Some were warm, ai- 
fectionate people who gained and gave 
satisfaction in their relationships with 
children. These did not have severe con- 
flicts or high levels of anxiety, but met the 
problems of their environment in a ma- 
ture manner. 
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THE RELATIVE DIFFICULTY OF VARIOUS TESTS FOR SIXTY 
FEEBLEMINDED INDIVIDUALS ! 


GRACE 
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St. Paul, Minn. 


INTRODUCTION 


In reports discussing the characteristics 
of the teebleminded, the conclusions are 
often less convincing than they might be 
hecause of the uncertainty of the reader 
as toghe range and type of deficiency in- 
cluded in the group studied. If special 
disabilities that tend to lower the reaction 
level on tests such as the Binet and 
Wechsler Bellevue are confused with gen- 
eral retardation, the characteristics of the 
groups studied will vary according to the 
proportion of cases suffering from special 
disabilities, and the types of special dis- 
abilities represented in 
group. 


each separate 
In the present study, an attempt 
has been made to exclude all cases of spe- 
cial disability, specifie handicap, or emo- 
tional disturbance, in order to examine 


_the characteristics of a group in which the 


individuals are suffering from general 
mental retardation and from that alone. 
With a clear picture of the characteristics 
of general mental retardation, the task of 
the clinical psychologist in recognizing the 
presence of specific handicaps and dis- 
abilities should be somewhat less difficult. 

In the general population, some indi- 
viduals with special language ability ob- 
tain ratings on the Binet and other verbal 
scales that are considerably above their 
general reaction level. On the other hand, 
those with special reading disabilities ob- 
tain ratings on the Binet and other verbal 
scales that are significantly below their 
general level of reaction. Special abilities 
and disabilities as well as various kinds 
of physical handicaps often tend to con- 
fuse the diagnostician in his attempt to 


determine whether a given individual is 
essentially normal in spite of certain spe- 
cial defects that tend to lower his reaction 
level, or requires lifelong supervision be- 
cause of general mental defect. This study 
is an attempt to clarify the picture of gen- 
eral mental retardation, uncomplicated by 
special handicaps or disabilities. 


MATERIALS 


For 27 girls and 33 boys with chrono- 
logical ages ranging from 15 years and 2 
months to 19 years and 6 months, in- 
clusive, ratings were obtained with the 
Binet scale and with Form I of the Point 
Scale of Performance Tests. These 60 
individuals had been committed to state 
guardianship as feebleminded. Each one 
had an intelligence quotient of less than 
75 on both the Binet and the performance 
scale. 

The 60 individuals included this 
study are called “simple aments’’ be- 
cause their inferior intelligence ratings 
cannot be ascribed to any known cause 
other than general mental retardation. 
No cases of impaired hearing, defective 
vision (other than that corrected by 
glasses), defective speech, foreign lan- 
guage handicap, special reading disability 
or any other recognized handicap were 
included. Nothing in the histories of 
these individuals nor in their examina- 
tions suggested the possibility of cerebral 
palsy, epilepsy, encephalitis or other acci- 
dent to the central nervous system, nor 
was there any indication of glandular 
imbalance that might tend to slow down 
or speed up psychomotor reaction. 


RESULTS 


These 60 “simple aments” earned a 
median IQ of 61 on the Binet scale 
(Qi = 10 55; Os = 10 64.5). On Form 
I of the Point Scale of Performance Tests 
they earned a median 10 of 62 (Qi = IQ 
54; Os = 10 67). The difference be- 
tween the Binet 10 and the Performance 
1© for an individual ranged from +-0 to 
17 points. If the Performance IQ was 
higher than the Binet IQ for an individual, 


the difference between the two IOs was . 


recorded as a plus value. If the Perform- 
ance IO was lower than the Binet 1Q for 
the individual, the difference between the 
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two IQs was recorded as a minus value. 
With these differences between the ‘IQs 
for the sixty individuals arranged accprd- 
ing to algebraic magnitude, their median 


was found to be +0 (Qi = —5 10 
points: that is, the Performance 1Q was 5 
points below the Binet 10, and Qs = +4 


IQ points: that is, the Performance IQ 
was 4 points of 10 above the Binet IQ), 
Arranged according to arithmetic value, 
the median difference between the two sets 
of ratings was 4 points of IQ (Qi = 2 
points of 1Q, Qs = 7 points of IQ). The 
median mental age on Form I as a whole 
was 9 years and 4 months (Q1-= & vears, 
2 months; Os = 10 years, 1 month). 

Inspecting the median mental ages 
earned on the various tests of Form I of 
the Point Scale of Performance Tests, we 
find the Knox Cube Test and the Kohs 
Block Design Test to be the most difficult 
for this group. On the Knox Cube Test, 
the median mental age was 6.5 years 
(QO: = 5.5 years, Os = 6.5 years). The 
difficulty of an attention test for the feeble- 
minded is indicated by the fact that the 
upper quartile for this group is repre- 
sented by the same value as the median. 
Three individuals of the 60 were able to 
earn scores on this test that fell within 
normal limits. On the Kohs Block De- 
sign Test, also, the median mental age 
for this group was 6.5 years (Qi Be. 
years, Os 8.5 years). No individual 
earned a score within normal limits on 
this test. The highest mental age earned 
by any member of the group was 10.5 
vears. 

On the Healy Picture Completion Test 
I, the group earned a median mental age 
of 8.5 vears (Qi 6.5 years, Os 11.5 
years) with & individuals earning ratings 
within normal limits. \1f this test meas 
ures something akin tO language ability, 
the wide range of scores from less than 
5.5 years to more than 15.5 years can be 
understood as due-to a special ability 
rather than to a general factor. For the 
Porteus Maze Test, there is the same wide 
range of scores, with three individuals 
earning a mental age of less than 5.5 
vears, and six earning a mental age of 14.5 
years or higher. Eleven scores of the 60 
fell within normal limits. Here, as with 
the Healy Picture Completion I, one sus- 
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pects that factors other than general intel- 
ligence are contributing to success. On 
this test, the group earned a median 
mental age of 8.5 years (Qi = 7.5 years, 
Os = 10.5 years). 

The mental ages earned with the 
Seguin Form Board, like those from the 
Knox Cube Test are closely grouped about 
the median. Five are within normal lim- 
its. The median mental age for the group 
on this test is 9.5 years (Qi = 8.5 years, 
Qs = 10.5 vears). 

The median mental age earned with the 
Casuist Form Board was 9.5 years (Qi = 
7.5 vears, Os 12.0 years). Ten boys 
and 5 girls earned scores within normal 
limits on this test. The range of mental 
age scores for the girls was 6.5 to 14.5 
years, inclusive, while that for the boys 
was from 7.5 to more than 15.5 years. 
The Manikin-Feature-Profile Test, also, 
yielded a median mental age of 9.5 years 
for this group (Qi = 7.5 years, Oa = 
14.5 years) with 15 boys and 7 girls earn- 
ing mental age scores within normal lim- 
its. 

Scores earned with the Mare and Foal 
Test tended to follow the other puzzle 
type form boards. They imdicated that 
this test was even easier for this group 
than the Casuist Form Board or the Mani- 
kin-Feature-Profile Test. This is inter- 
esting, in view of the fact that it is one test 
of Form [ on which individuals with su- 
perior ability of this age range are likely 
to earn lower scores than on the scale as 
a whole. The median mental age earned 
was 12.5 vears (Qi 9.5 years, Os = 
15.0 vears ). 

Of the 8 tests of Form [ of the Point 
Seale of Performance Tests, the Knox 
Cube and the Kohs Block Design Tests 
were the most dificult for this group of 
OO “simple aments,” without apparent 
physical handicaps or known special dis- 
abilities, between the ages of 15 years, 2 
months, and 19 years, 6 months, inclusive. 
The Knox Cube Test identified all but 
three of these individuals as feebleminded. 
The Kohs Block Design Test diagnosed 
all of the 60 as feebleminded, from the 
standpoint of general mental development 
as measured by this test. 

Kach test of Form [I of the Point Scale 
of Performance Tests had been included 


in that scale because of its discriminative 
value. Each test is weighted at each 
chronological age level according to its 
discriminative value at that level. On the 
basis of data presented in this study, it 
appears that the omission of the puzzle 
form boards, the Casuist, the Manikin- 
Feature-Profile and the Mare and Foal, 
would not reduce the usefulness of the 
scale for identifying feebleminded indi- 
viduals between 15 and 20 years of age 
without special handicaps. These puzzle 
form boards, however, may serve a special 
purpose in selecting from a group of 
mentally retarded, those who will be able 
to acquire enough manual skill at simple 
tasks to enable them, under proper super- 
vision, to earn at least partial support. 

Ifthe Knox Cube Test measures atten- 
tion span, its success in identifying indi- 
viduals with general mental defect would 
be in accordance with Spearman's concept 
of the close relationship between the ca- 
pacity for attention and general intelji- 
gence. If the Kohs Block Design Test 
measures reasoning ability, the lack of 
success of this group of feebleminded in- 
dividuals with that test supports the 
opinion of many psychologists as to the 
importance of reasoning as a factor im gen- 
eral intelligence. 

SUMMARY 


In the present study, an attempt has 
been made to determine some of the intel- 
lectual characteristics of 27 girls and 33 
boys who had been committed as feeble- 
minded, These 60 “simple aments” were 
suffering from general retardation, and, 
as far as could be determined, from no 
other type of handicap. No cases of physi- 
cal handicap, special disability or emo- 
tional disturbance were included in the 
group. 

These 60 individuals were between 15 
and 20 years of age. [Qs were available 
for each individual on the Binet scale and 
on Form [ of the Point Scale of Perform- 
ance Test. All [Qs obtained on both 
scales were less than 75. The median IQ 
on the Binet scale was 61. The median 
IQ on Form | of the Point Scale of Per- 
formance Tests was 62. ‘The median dit- 
ference between the ratings obtained on 
the two scales when these were arranged 
according to algebraic magnitude was 
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+0. The median of the arithmetic dif- 
ferences was 4.0 points of IQ. There was, 
therefore, no tendency for the feeble- 
minded individuals of this group to ac- 
complish more on the non-verbal than 
on the verbal scale. 

Of the tests of Form | of the Point 
Seale of Performance Tests, the Knox 
Cube Test and the Kohs Block Design 
Test were the most difficult for this group. 
The median mental age earned on Form 
| as a whole was 9 years and 4 months. 
For both the Knox Cube Test and the 
Kohs Block Design, the median mental 
age earned was 6.5 years. On the Healy 
Picture Completion I, and on the Porteus 
Maze Test, the median mental age earned 
was 8.5 vears. The mental ages earned 
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with the Seguin Form Board were closely 
grouped around the median, which was 
9.5 years. The Casuist Form Board and 
the Manikin-Feature-Profile Test also 
yielded a median mental age of 9.5 years, 
but with a wide range of scatter. On the 
Mare and Foal, the median mental age 
was 12.5 years. 

Judging from these results, it would 
seem there tends to be little difference be- 
tween verbal and non-verbal abilities in 
these 60 cases of general mental retarda- 
tion, Of the abilities measured by the 
non-verbal scale employed, attention as 
measured by the Knox Cube Test, and 
reasoning ability as measured by the Kohs 
Block Design Test seemed to be most 
conspicuously retarded. 


SCHIZOPHRENIA 


Chicago State Hospital 


INTRODUCTION 


The purpose of this study was to con- 
duct a clinical investigation of the Schizo- 
phrenia scale (Sc) of the Minnesota 
Multiphasic Personality Inventory 
(MMPI). The question was: Can the 
Se seale taken by itself suffice as a valid 
indicator of a schizophrenic psychosis? 
The actual study necessarily broadened 
itself to include an investigation of the 
other scales of the MMPI, profile analy- 
sis, and a complete item analysis. 

Published research of test results on 
_ schizophrenics has been scarce and rather 
disappointing. Several studies using the 
Bernreuter Personality Inventory have 
appeared@. 4° general, attempts 
to diagnose and differentiate schizo- 
phrenics using’ the various paper-pencil 
personality tests have met with dubious 
success. As far as the writer has dis- 
covered, only two studies have appeared 
which bear somewhat on the present 
problem. Benton") administered the 
MMPI to &5 patients of whom only 10 
were schizophrenics. He states that the 
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and Loyola University 


MMPI is not successful in identifying 
schizophrenics, since of these 10 patients, 
only five gave “positive” results on the 
Se scale. 

A more adequate study using 40 cases 
is reported by Pacella, Piotrowski, and 
Lewis®). The 22.) schizophrenics who 
later showed improvement following clec- 
tric convulsive treatment had a mean Se 
scale T score of 65.27. The 18 schizo- 
phrenics who showed no improvement 
after ECT had a mean Se TO score of 
70.33. No measure of scatter is reported. 


Meruop 


The present study is based on a group 
of SO clinically diagnosed schizophrenic 
patients at the Chicago State Hospital. 
The average age was 32 years with a 


range from 15 to 53 years. 
37 males and 43 females. The various 
“types” of schizophrenics and their re- 
spective numbers were as follows: Para- 
noid 31; Mixed 17; Undetermined 22; 
Simple 4; with Manic features 2; Cata- 
tonic 2; in Psychopathic Personality 1; 
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Hebephrenic 1. The individual form of 
the MMPI was administered to all of the 
above patients and this involved a selec- 
tion factor since only those patients who 
could read and cooperate sufficiently well 
were tested, 


RESULTS 


In terms of per cent of agreement with 
medical staff diagnosis it was found that 
in 41 per cent of the cases the Se scale 
was 70 or above. In only 22 per cent of 
the cases was the Sc score the highest of 
all the other scales, either above or be- 
low the T score of 70; and in only 20 per 
cent of the cases was the Se scale the 
highest of the scales and also above the 
pathological T score of 70. 

Recalling the suggestion given by 
Hathaway and Mckinley that sometimes 
one can make a better diagnosis of schizo- 
phrenic by examining a significantly high 
Paranoia (Pa) or Psychasthenia (Pt) 
score, a count showed that the Pa scale 
was 70 or above in 37 per cent of the 
cases, and in 12 per cent of the cases the 
Pa score was the highest scale and above 
70. The same procedure was carried out 
for the Pt scale. In 28 per cent of the 
cases the Pt score was 70 or above; and 
in 2.5 per cent, the Pt scale was highest 
and 70 or above. 

In order to construct a “typical” pro- 
file for purposes of profile analysis, the 
mean T scores for all the scales of the 
MMPI were calculated along with the 
standard deviations. Correlations were 
also obtained between each scale and the 
Se scale. The findings are presented in 
Table 1. No significant sex differences 
were noted, 


Paranoid Schizophrenia. Since the 31 
cases diagnosed as paranoid schizophrenia 
were the largest single subdiagnostic cate- 
gory, this group was separated from the 
other types of schizophrenia in an effort 
to determine whether or not the presence 
of this relatively large number of para- 
noid schizophrenics influenced our re- 
sults with the 80 cases to any appreciable 
extent. It was also hoped that some char- 
acteristics peculiar to paranoid schizo- 
phrenics might appear on the MMPI. A 
statistical summary of the findings is pre- 
sented in Table 1. Examination of the 
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mean scores for the various scales on 
Table 1 reveals a very close approxima- 
tion to the results obtained with the en- 
tire 80 cases. 


Age Differences. It was noted on super- 
ficial profile inspection that the young 
early cases of schizophrenia seemed on 
the whole to obtain more bizarre and 
unusual looking profiles. This suggested 
the possibility of an age factor. Accord- 
ingly, the group of 80 schizophrenics was 
divided into three age groups: 15 to 29 
(33 cases), 30 to 39 (31 cases), 40 to 53 
(16 cases). The same statistical methods 
of handling the data were employed in 
all three groups. The results are sum- 
marized in Table 1. 

It appears that an age factor is operat- 
ing. Comparison of the three age groups 
reveal the so-called “levelling off” process 
traditionally described in schizophrenics 
with advancing age. The youngest group 
exhibits a degree of disorganization and 
dissociation on the MMPI which is 
markedly pathological. The next age 
group exhibits a definite lowering of 
scores to within normal limits. The last 
age group manifests a profile which is in 
all respects “normal.” 

Contrasting the first age group with the 
results of the entire 80 cases reveals a 
general tendency for the young early 
cases to be much less on the defensive in 
taking a test of this kind. Their guard 
seems to be down, and they tend to be 
rather harsh in their judgments of them- 
selves and their conduct. This “over- 
honesty” is manifest in the negative cor- 
relation between the K scale and the Sc 
scale. In other words, the higher the 
Se score tends to go, the more prevalent 
do feelings of inferiority and inadequacy 
become. We also noted a marked in- 

‘crease in the direction of somatic pre- 
oceupation in the earlier cases with high 
Se scores as indicated by the increase in 
r from .52 between Hs and Se on the 80 
cases to an r of .75 between the same 
scales on the age group 15 to 29. Corrob- 
oration for the assumption of hyper- 
emotionality in the younger schizophren- 

ics appears in the marked increase in r 

between Hy and Se from .63 for the 80 

cases to .87 in the age group 15 to 29. 
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Further evidence of the general presence 
of hyper - emotionality with consequent 
hyper-activity is brought out in the great 
increase in r between Ma and Sc trom 
37 for the 80 cases to .74 for the 33 
youngest cases. However, these conclu- 
sions apply only to those cases in which 
the Sc score has been revealing. 


Item Analysis. An extensive item analy- 
sis was conducted in an attempt to dis- 
cover the relative diagnostic significance 
of the various test items of the Se scale. 
One would expect a fair amount of 
agreement among diagnosed schizophren- 
ics on the items making up the Sc scale. 
Empirically this was not the case. 

The analysis of the items of the Se 
scale on the entire 80 cases was singularly 
insignificant. Analysis of the responses 
of the 33 youngest and most pathological 
cases also failed to show a. significant 
amount of agreement and consistency 
among the patients to provide a safe 
basis for generalization. 

Somewhat more definite results with 
much higher percentages of agreement 
were obtained on the other scales. How- 
ever, since none of these scales purports 
to “measure” a psychosis (as does the Sc 
scale by its very title), no clear-cut pic- 
ture descriptive of any psychosis was ob- 
tained. It is interesting to point out that 
a picture was obtained, nevertheless, 
which might have some bearing upon the 
pre-psychotic schizophrenic personality. 
It appears that the schizophrenics used 
in this study tended to describe them- 
selves as suspicious, mistrustful, and 
quarrelsome, entertaining strong feelings 
of aggression and hostility coupled with 
the opposite tendency to give up and 
withdraw from further environmental 
stimulation and participation. Mood 
swings were also described from extreme 
hyperactivity to retardation and depres- 
sion. Obsessive thinking was also noted. 
In addition, these schizophrenics felt that 
they were markedly sensitive, impatient, 
stubborn, and allowed the spirit of re- 
venge and vindictiveness to overcome 
them quite often. Finally, there is a 
definite indication of deep dissatisfaction 
with the home situation. 

None of these “traits” considered in 
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themselves, or taken together, necessarily 
describes a particular psychosis; but they 
do point to unwholesome attitudes which 
may make an individual “psychosis- 
prone. 


SUMMARY AND CONCLUSIONS 


The MMPI was administered to 80 
clinically diagnosed schizophrenics. Re- 
sults indicate that the Se scale taken by 
itself is not an adequate or valid diag- 
nostic tool, Furthermore, attempts at 
diagnosis by profile analysis are also 
relatively without value because of the 
large individual variation. It is possible 
that part of this failure may be a function 
of current inadequate medical diagnoses, 
especially in the area of the schizophrenic 
psychoses. Some tendency for the young- 
er cases to obtain more markedly patho- 
logical scores on the Se scale was noted, 
but again the individual variability was 
so great as to preclude valid generaliza- 
tion in a particular case. A comprehen- 
sive item analysis was carried out. The 
items of the Se scale itself proved to be 
non-discriminatory. An item analysis of 
the other scales tended to portray a fairly 


valid cluster of pre-psychotic personality 
traits and attitudes. It is felt that in clini- 
cal practice, the MMPI, taken by itself, 
cannot be considered as a valid tool in 
diagnosing schizophrenia. 
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CHANGES IN GOODENOUGH DRAWINGS ASSOCIATED WITH 
CHANGES IN SOCIAL ADJUSTMENT 


ELEANORE OCHS 


Bellevue Psychiatric Hospital, New York 


INTRODUCTION 


Experience with the Goodenough 
drawing scale") suggests that child’s 
abiliiv to draw a man is related to his so- 
cial adjustment. Hinrichs), for instance, 
found that the boys in his “problem 
group” scored lower on the drawing scale 
than did the boys in the “non-probleny’} 
group. Yepsen’? reported a reliable in- 
feriority in drawing performance of so- 
cially maladjusted feebleminded boys as 
compared to their well-adjusted controls. 
The purpose of the present study was to 
determine whether improvement in social 
adjustment in a particular child is paral- 
leled by inerease Goodenough draw- 


ing 1Q as might be expected on the basis 
of clinical and experimental findings. 


EXPERIMENTAL DESIGN 


The subjects of this investigation were 
124 patients at the Children’s Unit of 
Rockland State Hospital. All of them 
had been diagnosed within the group of 
Primary Behavior Disorders. Every case 
from the file was used provided the imi- 
tial Goodenough mental age was below 
11-6 vears and re-tests could be obtained 
for intervals not less than 5 months nor 
exceeding 36 months. Two-thirds of the 
group were boys and one-third girls, a 
sex distribution corresponding to that of 
the Children’s Unit in general. 


? 
4. 
5. 
6. { 


CHANGES IN GOODENOUGH DRAWINGS 


Taste 1. Changes in Goodenough 10 on Re-Tests 


% show- 
mg mcrease 


% showing 
no change 


% show- 


ing decrease 


27.14 (7.42)* 
60.0 (12.27) 


AS 


71.43 (9.66) 1.43 
38.0 (11.1) 20 


* The numbers in brackets represent the 
pots. 


Entries in the patients’ hospital charts 
served as the basis for evaluating changes 
in social adjustment. These charts con- 
tain detailed and frequent reports on the 
children’s behavior and progress. — For 
the purpose of this study we considered 
all reports available on a given child for 
the period intervening between his two 
Goodenough tests. Areas on which at- 
tention was focussed included the child's 
relationship to the cottage group, his 
ability to follow routine, classroom be- 
havior, and relation to various staff mem- 
bers. A difficulty encountered was the 
fact that the different entries on the pa- 
tients were not always in agreement with 
each other; different reporters would 
disagree or the child would be inconsist- 
ent, showing improvement for a few 
months and then relapse again. We at- 
tempted therefore to determine the main 
trend in adjustment for the period under 
study, reserving the term “improvement” 
for those children who showed clear evi- 
dence of progress beyond that which 
might be expected with increase in age. 
In this manner the children were classi- 
fied in either Group [ (Improved) or 
Group (Unimproved). Four patients 
could not reliably be assigned to either 
group and were consequently’ excluded 
from our study. Group | was comprised 
of 41.7 per cent of the total while Group 
U was comprised of 58.3 per cent. The 
median initial C. A. in Group I was 9-11 
years and in Group U 9-5 years. The 
ranges in C. A. extended from 5-5 to 
13-3 vears and from 5-3 to 13-2 respec- 
tively. Thus, the two groups were simi- 
lar in terms of chronological age. In 
terms of general intelligence the groups 
also approximated each other closely, the 
mean Revised Stanford-Dinet IQ) being 
89.6. Concomitant performance ratings 
on either the Arthur Point | or the Cor- 
nell-Coxe scales were available for a 


mean increase or decrease in terms of IQ 


limited number of children only, but the 
mean performance 1Q’s available indicate 
that the groups tended to be similar in 
average performance ability. For the 
groups combined the mean performance 
IQ was 91.8. In evaluating the IQ's it 
must he stressed that, since we were deal- 
ing with disturbed children, the obtained 
ratings represented only the functional 
level while probably underrating the best 
potentialities. 

In comparing the two drawing results 
on each child, the following points were 
considered: (1) differences Good- 
enough IQ and the direction of these 
ditferences; (2) scoring items added to 
the initial score and those omitted on re- 
tests; (3) qualitative changes. All tests 
were administered individually and by a 
number of different examiners. ‘The me- 
dian initial Goodenough MA was 7-9 
years for Group | and 7-3 for Group U. 
The average discrepancy between the imi- 
tial Goodenough and Binet [Q’s was 
similar for both groups but slightly great- 
er for Group [. On the initial examina- 
tion the mean drawing IQ was 80.2 for 
the groups combined, thus 9.4 points be- 
low the Binet 10. The average interval 
elapsing between  re-tests was 13.74 
months for Group | and 15.27 months 
for Group U. 

RESULTS 


The changes in Goodenough JQ ob- 
served on re-testing of the two groups are 
summarized in Table 1. 

Inspection of this table reveals a de- 
crease in Goodenough 1Q in 71.43) per 
cent of Group U as compared to only 38.0 
per cent of Group I. On the other hand, 
an merease in IQ was noted in 60.0 per 
cent of Group | as compared to only 27.14 
per cent of Group U. The total average 
change in IQ of Group U amounted to a 
decrease of 4.89 points while Group I 
showed an increase of 3.14 points. This 
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difference statistically reliable as 
shown by a critical ratio of 2.74. 
Inspection of scoring items added to or 
omitted from the original drawing failed 
to show much consistency within each of 
the groups. Most of the items which 
were frequently added were identical for 
both groups. These items were of medial 
difficulty as established by Goodenough”). 
Their addition to the initial score can be 
explained most simply as the result of a 
certain amount of conceptual development 
during the testing interval. The only 
items added to the original more con- 
sistently in Group [ than in Group U 
included items 4c, 6b, 7d, 10c, and 11a. 
In Group U items 9%, 9b, and 10e were 
added somewhat more frequently than 
any other item. No items were consist- 
ently omitted on re-tests in Group I 
while in Group U items 8a, 10a, 12a, 16a, 
and 17a were comparatively often omit- 
ted on re-tests after having been present 
in the original drawing. <As_ regards 
changes in quality of drawing no  strik- 
ing differences were noted between the 
two groups. .\ number of children pro- 


duced better organized and larger figures 
on re-tests while the reverse tendency was 


rare. This may perhaps be the result of 
better security due to increased familiarity 
with the test and Hospital in general as 
compared to the initial testing situation. 
Re-tests on the Revised Stanford-Binet 
were available on 29 per cent of the total 
group, including 16 unimproved and 19 
improved subjects. For the improved 
subjects the average ditference between 
sinet and Goodenough IQ's decreased 
7.6 points while for the unimproved sub- 
jects the difference between the two 
,1Q’s increased 4.5 points. 


i SUMMARY 


1. Our results suggest a tendency for 
Goodenough [Q's to increase with better 
social adjustment and to decrease with 
continued maladjustment. This finding 
lends support to the original assumption 
that the drawing scale measures factors 
related to socialization in children. The 
incidental finding of closer approximation 
of Goodenough and Binet re- 
tests in Group I with the reverse trend 
in Group U, though a suggestive lead 
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only due to the small number of cases, 
confirms earlier studies which found a 
relationship between social maladjust- 
ment and discrepancy between Binet and 
Goodenough IQ’s. 

2. Little consistency was found within 
either group as regards addition or omis- 
sion of scoring items on re-tests as com- 
pared to initial test. The points more 
frequently added in Group I than in 
Group U depended upon rather exact 
observation and representation of more 
advanced details. The groups did not 
ditfer consistently in terms of changes in 
quality of drawings on re-tests, aside from 
those already considered in the objective 
scoring. 

3. The findings obtained here can be 
considered only as representing a group 
tendency. The indications are that the 
correlation between improved social ad- 
justment and drawing score is positive 
but only moderately high since social ad- 
justment appears to be only one of sev- 
eral factors affecting Goodenough per- 
formance. For example, a child suffer- 
ing from some organic involvement could 
not be expected to show much drawing 
improvement in spite of improved sociali- 
zation. Conversely, children with spe- 
cial reading disabilities sometimes. start 
out with good drawing scores and could 
not be expected to show great increase in 
Goodenough score within relatively brief 
time intervals. 

JIBLIOGRAPHY 
GOODENOUGH, FLorENcCE L. Measurement 
of Intelligence by Drawings. Yonkers-On- 
Hudson: World Book Co., 1926. 
GoopENOUGH, FLoRENcE L. Studies in the 
Psychology of Children’s Drawings. Psy- 
chol. Bull., 1928, 25, 272-283. 
Hinricus, W. E. The Goodenough Draw- 
ing Test in Relation to’ Delinquency and 
Problem Behavior. Archiv. Psychol., No. 
175, 1935, 1-82. 
Macnover, Karen. Personality Projec- 
tion in the Drawing of the Human Figure 
Springfield, [Ill.: Charles C. Thomas, 1949 
Marcotts, Murer F. A Comparative 
Study of Figure-Drawings at Three Points 
in Therapy. Rorschach Res. Exch., 1948, 
12, 94-105. 
Sprincer, N. N. A Study of the Drawings 
of Maladjusted and Adjusted Children. J. 
genet. Psychol., 1941, 56, 131-138. 
Yersen, L. N. The Reliability of Good- 
enough Drawing Test with Feebleminded 
Subjects. J. educ. Psychol., 1929, 20, 448- 
451. 


|_| 

| | 
| 
| 


PREDICTION OF THE RESPONSE OF SCHIZOPHRENIC PATIENTS 
TO ELECTRO-CONVULSIVE THERAPY* 


JOHN PEARSON 


Veterans Administration Hospital, Minneapolis, Minnesota 


The value of the Minnesota Multi- 
phasic Personality Inventory’) in_pre- 
dicting the response of psychiatric pa- 
tients to electro-narcosis therapy has been 
demonstrated by Harris, et al.-’. Hales 
and Simon), in a similar study of insulin 
shock therapy found some prognostic sig- 
nificance in the MMPI results though the 
evidence was not conclusive. 


Metuop 


In an attempt to extend and confirm 
some of the findings of these studies the 
case histories of 60 white male veterans, 
patients on the psychiatric ward at the 
above installation were examined. These 
cases comprised a group of which each 
member had completed a course ef three 
or more electric shock treatments between 
November 1948 and May 1949. 

Thirty-nine of this number had taken 
the MMPI within seven days prior to the 
first EST treatment. Of the remainder, 
some were unable to sort the test item 
cards because of the severity of their ill- 
nesses and in other cases it was deemed 
necessary to begin treatment so soon after 
. admission that a pre-shock record could 
not be obtained. No attempt was made 
to control such factors as previous elec- 
tric shock series and/or insulin treat- 
ments, coramine injections, and insulin 
used concurrently with the electro-shock 
treatments. 

Judgments of “‘good” and “poor” re- 
sults of shock treatment for the cases on 
whom the MMPI was available were 
made on the basis of the psychiatrist’s 
statements relating to EST in the dis- 
charge summary or in a few cases where 
patients were still in the hospital, upon 
the verbal report of the psychiatrist in 
charge. Statements indicating any de- 
gree of improvement whatsoever were 
considered as evidence of a “good” re- 
sult regardless of the final evaluation of 

* Published with the permission of the Dean's 


Committee (Neuropsychiatry), University of 
Minnesota. 


the total hospital result. These state- 
ments were of this general sort: 

e after the fifth, treatment there 
was considerable improvement the 
man’s mental status. At the end of 
the shock therapy it was seen that the 
man was markedly improved. 2 


The result was rated as “poor” if no 
change or a change for the worse was ob- 
served. These judgments were based on 
statements such as: 


“Electric shock therapy was instituted 
with 15 treatments being given. There 
was no noticeable change. 

i . he received 16 such treatments, 
these treatments apparently bringing out 
more pathology. In the last day or so he 
has been assaultive. 


It should be emphasized that these 
judgments were based solely on the etf- 
fectiveness of EST per se insofar as this 
could be determined. In some of the cases 
rated as “good” result, the benefits were 
quite transient and the progress of the ill- 
ness necessitated commitment to long 
term treatment in hospitals for psychotics 
while in a number of the cases rated 
“poor,” the total hospital result effected 
a satisfactory return to society. The rea- 
sons for establishing the criteria for the 
result of treatment on these bases were 
first, that it seemed desirable to consider 
the immediate and directly observable ef- 
fects of shock and second, that no ade- 
quate basis existed for separating the long 
term results of shock from the long term 
results of an active “total push” hospital 
program. 

Attempts were then made to discover 
factors in the MMPI profiles which might 
enable the prediction of the result of the 
shock therapy. Of the 39 records ten 
were eliminated because of the fact that 
they constituted a group of involutional 
psychoses, psychotic depressive reactions, 
and mixed psychoneuroses for whom the 
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result of shock therapy was uniformly 
good and it was readily apparent that 
their clustering on certain scales would 
spuriously raise the discriminatory pow- 
ers of the test. It was likewise apparent 
that the factors involved in differential 
response to EST as defined by our cri- 
teria for “good” and “poor” results were 
related to the clinical picture of schizo- 
phrenia. Accordingly, the remaining 
cases, 29 in number, were considered, Of 
this group 16 were classified as respond- 
ing poorly to EST and 13 classified as 
having made a good response. The 
“poor” group included 15 cases of schizo- 
phrenia; 10 paranoid type, two catatonic, 
two simple, and one hebephrenic. The re- 
maining case was diagnosed “dissociative 
reaction with depersonalization.” Of the 
13 cases in the “good” group, nine were 
diagnosed paranoid schizophrenia, two 
catatonic, and two were termed “depres- 
sive reaction in a basically schizoid per- 
sonality.” 
RESULTS 

By tabulating a number of combina- 
tions of the MMPI. scale values, three 
variables appeared to differentiate the two 
groups well beyond the level of chance 
expectancy.* 


The indications from the MMPI were 
that the result of electric shock therapy 
was poor when: 


1. The T score on the “D” scale was 
greater than 84 or less than 55. 

2. The T score on the “Sc” 
greater than &4. 

3. The total number of the nine original 
clinical scales with T scores of 80 or 
above was four or more. 


scale was 


Combining these indicators enable pre- 
diction of the result of EST in 72% of 
the cases in this sample if none or one of 
the signs positive is considered to indicate 
a favorable prognosis for response to 
shock. Cutting at that level, EST would 
have been recommended for six patients 
who did not benefit from it and contra- 
indicated for only two patients. who did 
actually respond well. 

Moving the cutting point up to all 


* Probability of less than .01 according to the 
test of X°. 
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three signs positive as indicative of poor 
result eliminated the two cases where 
shock was falsely contraindicated and 
44% of the cases where the treatment was 
unavailing were still correctly identified. 

An independent sample of 15 cases was 
obtained between May and August 1949. 
Rated according to the same criteria, 
eight were judged to have made a good 
response to EST. Of these, seven were 
diagnosed schizophrenia, paranoid type 
and one schizophrenia, hebephrenic type. 
Of the seven cases in the “poor” group, 
four were of the paranoid type, two sim- 
ple, and one catatonic. 

The prognostic indicators held up as 
well in the cross validation sample as in 
the original group, thus it appears that 
the MMPI quite definitely reflects some 
factor or factors related to the differen- 
tial response of schizophrenic patients un- 
dergoing electric shock therapy. 

The distributions of the two samples 
with respect to the MMPI signs are com- 
bined in Table | where it may be seen 
that 11 or 48% of the cases which made 
a poor response are identified by their 
MMPI profiles as different from the en- 
tire group having made a good response. 
Taste 1. Combined distribution of original and 

cross validation groups. 


Number of patients 
Poor 
response 


Nuonber 
of SIGNS 


positive Good response 


14 


0 


0 
1 
2 
3 


In clinical terms as judged from inter- 
pretation of the MMPI scales, the pa- 
tients who made a good response to EST 
were characterized by a moderate to se- 
vere degree of depression in conjunction 
with symptoms such hallucinations, 
ideas of reference, and other abnormali- 
ties associated with the diagnosis of 
schizophrenia. The group which made 
the poor response on the other hand was 
characterized by an inappropriate free- 
dom from depression in the cases where 
the depression scale scores fell below T 
score 55 (this is in agreement with the 
finding of Harris, ef al.) and in the cases 


as 
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where extreme elevations of the depres- 
sion scale were noted, by a chaotic state 
perhaps best described as an abandonment 
of the struggle to retain contact with real- 
ity. The extreme elevation of the “Sc” 
or schizophrenia scale and the overall 
elevation of the profile in terms of the 
number of scales with T scores above 80 
found to be indicative of poor result are 
likewise thought to reflect this chaotic 
state rather than a mere increase in the 
number of psychotic symptoms. 

With regard to the application of the 
findings of this investigation, the sugges- 
tion seems warranted that the MMPI 
may be used effectively as a screening de- 
vice with schizophrenic patients for whom 
electric shock therapy is being considered 
and that patients for whom all three of 
the signs enumerated above are positive 
be given some other form of treatment. 
It is the impression of the writer that a 
large proportion of the group responding 
poorly to EST subsequently did well on 
insulin although unfortunately this im- 
pression could not be subjected to sys- 
tematic investigation. 

If nearly half of the patients who re- 
ceive no benefit from EST can be identi- 
fied by this means without falsely contra- 
indicating the treatment in cases where it 
might be effective, the various economies 
involved and the slight but detinite in- 
cidence of adverse effects from EST seem 
to indicate the use of the test in the man- 
ner described. 


SUMMARY 


The pre-treatment MMPI records of 
29 male psychiatric patients were ana- 
lyzed with respect to psychiatrists’ esti- 
mates of the patients’ responses to elec- 
tric shock therapy. These cases all bore 
psychiatric diagnoses of schizophrenia or 
closely related disorders. Three signs 
were found which enabled better than 
chance prediction of These 
signs indicate a poor response when the 
score on the depression scale lies above 84 
or below 55, when the score on the schizo- 
phrenia scale lies above 84, and when the 
total number of scales with T scores of 
8O or above is greater than three. A 
cross validation group of 15 cases yielded 
the same results as the original sample. 
The evidence is thought to support the 
use of the MMPI as a screening device 
for schizophrenic patients and that when 
all three of the signs are positive, electric 
shock is contraindicated. 


response, 
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INTELLECTUAL DISPARITIES IN A NORMAL GROUP AND THEIR 
RELATIONSHIP TO EMOTIONAL DISTURBANCE 


SEYMOUR FISHER AND HELEN SUNUKJIAN 


Elgin State Hospital 


INTRODUCTION 


The present study was undertaken with 
the idea of investigating intellectual dis- 
parities and deficits in a normal group 
and of relating these disparities to some 
kind of objective index of maladjustment. 
More specifically, it is the intention of 
the project to answer the following ques- 
tions: (1) What kinds of disparities and 
differences are there in the way normal 
subjects deal with a range of intelligence 
test tasks? (2) Do these disparities and 
differences fall into clusters or meaningful 
patterns? (3) Can one account for the 
disparities on the basis of emotional mal- 
adjustments ? 

PROCEDURE 


Subjects. The population studied con- 
sists of 35 subjects who were randomly 
selected from applicants for employment 
at the Elgin State Hospital, except that 
all those over 45 years of age were ex- 
cluded. It is recognized that our sub- 
ject population is limited in number, but 
the results obtained seem to be so consist- 
ent as to justify a preliminary report. 
There are 11 women in the group and 24 
men. The age distribution is wide; and 
a definite range of occupations is repre- 
sented. Thus, there are applicants for 
attendant’s positions, nurses, biochemists, 
kitchen helpers, maintenance men, truck 
drivers, ete. But it must be emphasized 
that the bulk of the applicants are for at- 
tendant positions. Furthermore, most of 
the subjects have a rural background. 
The educational range of the group is 
varied, extending from three years of 
grammar school to several years of col- 
lege training. The majority of the group 
has had an eighth grade education or 
higher. It is recognized that a certain 
selective process is involved in choosing 
subjects from those applying for posi- 
tions in a state hospital. However, the 
weight of the evidence implies that this 
group is a fairly representative one. Thus, 
the mean Wechsler-Bellevue Verbal 1O 


is 95.1, the mean Performance IQ is 97.4, 
and the mean Full Scale 1Q is 96.3. In 
addition, as has been indicated above, 
there is a good scatter of educational 
background and age. 


Method. The subjects were each given a 
battery of tests consisting of the Ror- 
schach Ink Blot test, Wechsler-Bellevue, 
and the Porteus Maze test. The Wechs- 
ler-Believue and the Porteus were in- 
cluded in this battery to obtain a wide 
sampling of the way in which subjects 
handle intelligence test tasks. The Ror- 
schach test was used as a measure of per- 
sonality adjustment, all Rorschach records 
collected being analysed in terms of rat- 
ings of how well emotionally adjusted the 
individual appeared to be. Ratings of the 
records were based on a two-fold division 
into “well adjusted” and “more poorly ad- 
justed.”” This gross rating procedure was 
finally adopted after the categories in a 
finer rating scale proved to be non-func- 
tional in that the great majority of the 
records were assigned to only two of the 
categories. A “constricted” category was 
set up for records under 10 responses 
which could not validly be rated. In pre- 
liminary preparation, the two judges who 
were to make the Rorschach ratings 
reached agreement as to the general 
criteria to be used in their judgments. 
Finally, each record in the experimental 
group was rated blindly and independently 
by each rater. When these ratings were 
completed it was found that there was 
very significant agreement between the 
judges. Thus, of the 70 ratings made 
there were only five instances of disagree- 
ment. Such disagreements were resolved 
by joint discussion. Ten records were as- 
signed by the ratings to the “well ad- 


justed” category (group 1); and 18 rec- 


ords were assigned to the “more poorly 
adjusted” category (group IL). Seven 
records which fell into the “constricted” 
category were dropped from the analysis. 


RESULTS 


Examination of the data indicates that 
there are real disparities in the results on 
different intelligence tests for the same 
individuals. Thus, the correlations of 
Wechsler-Bellevue scores with Porteus 
scores are very low—ranging below .35. 
The highest correlation which is +-.35 is 
between Wechsler Full Scale and Porteus. 
However, the disparities between the 
Wechsler scales themselves are much 
smaller; for the correlation between 
Wechsler Verbal and Performance is 
+-.67. 

In analysing the data from the point of 
view of a breakdown into the Rorschach 
rating groups, some interesting trends ap- 
pear. In terms of the Wechsler-Bellevue 
there are no differences in intelligence be- 
tween rating groups I and II. But the 
Porteus mean of group I is significantly 
greater than the Porteus mean of group 
Il. When group I and II are compared 
for the mean differences between Wechs- 
ler Verbal and Porteus, Wechsler Per- 
formance and Porteus, and Wechsler Full 
Scale and Porteus, it becomes apparent 
that group I (“well adjusted”) tends con- 
sistently to give larger differences than 
group II] (“poorly adjusted”) in the di- 
rection of better performance on the 
Porteus. A general check of the instances 
in each group in which the Porteus score 
exceeds or falls below the Wechsler score 
by at least five points reveals that 80 per 
cent of the group I subjects show im- 
provement and 20 per cent a decline on 
Porteus when compared with the Wechs- 
ler Full Scale. In group IL only 38 per 
cent show improvement on the Porteus 
and 44 per cent show a decline. General- 
ly, the subjects in group I tend to do bet- 
ter on the Porteus than on the Wechsler ; 
whereas the subjects of group II tend to 
do significantly worse on the Porteus. 
This is not a new finding, for there is at 
least one study which found results in a 
similar vein. Karpeles“'), using the 
Porteus and the Binet with groups of 
adjusted and maladjusted children, dis- 
covered that the maladjusted children 
showed little difference between Binet 


and Maze scores; but the well adjusted 
scored much higher on the Maze than on 
the 


tinet. It may be briefly conjectured 
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that such results are obtained because for 
both the maladjusted and well-adjusted 
normals performance on the Porteus is an 
emergency that arouses more anxiety than 
the usual intellectual type tasks and calls 
for extra effort. The well adjusted per- 
son rises to the occasion and exceeds his 
customary effort. But the maladjusted 
person in the face of emergency becomes 
disturbed by his mounting anxiety and 
tends to do worse. 

Approaching the Wechsler-Bellevue re- 
sults themselves, one finds no significant 
differences between the Verbal Scale and 
the Performance Scale in the various Ror- 
schach rating groups. A more detailed 
analysis to determine if there are any dit- 
ferences in Wechsler subtest means, when 
comparing group | with group II, reveals 
few significant differences. Actually, only 
two of the subtest mean differences ap- 
proach significance—viz., Comprehension 
and Picture Completion, Both of these 
differences favor group |. 

Another approach to the Wechsler data 
was attempted through analysis of the 
subtest means showing the average plus 
or minus position of each subtest in the 
individual subject's profile of scores. For 
each individual, the mean of the verbal 
subtests was computed and the plus and 
minus deviations of each subtest from the 
mean were recorded. Using the mean of 
the Performance Scales, the same cal- 
culations were made for each of the Per- 
formance subtests. Most of the results 
of this method of analysis are negative. 
In only two instances are there trends 
toward significance. The mean of the 
Picture Completion deviations in group 
I is +49; whereas the corresponding 
mean in group IT is Similarly, the 
mean of the Comprehension deviations in 
group I is -+- 2.40 and for group IL the 
mean is +-.70. It is interesting that Digit 
Span and Arithmetic are among the two 
lowest deviation means in both groups. 
However, there is no real difference in 
this respect between the groups. A care- 
ful generalized scatter analysis of the sub- 
tests was not attempted because of the 
negative results of previous related analy- 
ses‘? and because a preliminary work- 
ing with the data indicated that the Ror- 
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schach rating groups did not differ sig- 
nificantly in total scatter. 

These Wechsler results are not con- 
gruent with those found by Rapaport? 
They do not correspond either to the re- 
sults found by Rapaport for the group 
he calls “schizoid controls” or to the 
group he calls “anxious controls” ; and we 
assume that at least one of his groupings 
is an index of “maladjustment” in’ the 
same sense that it is defined here by the 
Rorschach. We do not find any of the 
significant differences for Object Assem- 
bly, Arithmetic or Digit Span that he de- 
scribes. The normal group here studied 
is probably more representative than his 
in the sense that there is a wider range of 
occupations present; but it is numerically 
smaller than his and consequently one can- 
not definitely say that his results are con- 
tradicted. However, some question con- 
cerning their validity is raised. There is 
agreement in detecting a real difference 
between the “adjusted”, and ‘“malad- 
justed” normals for Picture Completion. 
Altogether, the tenor of the data suggests 
that the Wechsler-Bellevue considered in 
a purely quantitative sense does not dis- 
tinguish well adjusted from more poorly 
adjusted normal persons. 


SUMMARY 


1. Thirty-five normal subjects were 
given a battery of tests including the 
Wechsler-Bellevue Intelligence Scale, the 


Porteus Maze test, and the Rorschach Ink 
Blot test. 

2. The Rorschach records were classi- 
fied by two raters into a “well-adjusted” 
group, a “maladjusted” group, and a 
“constricted” group. Despite the limited 
size of the groups, certain interesting 
trends could be detected. 

3. The subjects of the “well-adjusted” 
normal group tend to do significantly bet- 
ter on the Porteus than on the Wechs- 
ler-Bellevue; whereas the subjects of the 
“maladjusted” normal group tend to do 
worse or about equally well on the 
Porteus. 

4. Only two of the subtests on the 
Wechsler-Bellevue (viz., Comprehension 
and Picture Completion) seem to show 
signs of differentiating at all between 
the “well-adjusted” and “maladjusted” 
groups. In general, the Wechsler consid- 
ered in terms of its quantitative scores 
does not seem to be sensitive to malad- 
justment in the normal range. 
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INTRODUCTION 

Clinical application has shown that the 
Murray Thematic Apperception Test can 
serve a useful purpose in eliciting the con- 
tent of personality and in planning psy- 
chotherapy. Clinicians have also become 
aware of its limitations in testing young 
children. The most obvious of the inade- 
quacies which have been noted include: 
(1) the length of the story told, (2) the 
amount of description evoked, and (3) 
blocking on individual cards and the test 
as a whole. 

In an effort to overcome these deficien- 
cies the writer, in the Spring of 1948, 
used a series of pictures of rabbits taken 
from a child's book and compared the 
elicited projections with the projections 
obtained by use of the TAT. The results 
of this preliminary investigation appeared 
promising, but, since many of the children 
recognized the pictures, the stories which 
were told in several instances closely re- 
sembled the story in the original book. 
Consequently a series of ten color pictures 
of animals engaged in various activities 
was designed to test the hypothesis that 
this type of picture would elicit a greater 
quantity and more meaningful projections 
than do the TAT cards when used with 
children in the age range five to ten vears. 

The ten cards which were developed 

1. The writer is indebted to the University 
of Kentucky Research Fund Committee for a 
grant in aid which made possible this investi- 
gation. 


ANIMAL PICTURES FOR OBTAINING CHILDREN’S PROJECTIONS’ 
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for the investigation were given to 48 
school children ranging from 5 to 10 years 
in age. Twenty-four of these children 
were boys and 24 were girls. In each 
age group from five to ten there were 
four boys and four girls. 

Each child was tested with the first ten 
of the TAT cards, using cards appro- 
priate to the sex of the child, and with 
the ten animal cards. At each level two 
of the boys and two of the girls were ex- 
amined first with the TAT cards and 
then with the animal cards. The other 
four children at each age level were tested 
first with the animal cards and then with 
the TAT. 

All stories were recorded on wire and 
verbatim transcriptions were obtained 
from these recordings. 

RESULTS 

It was decided, for this preliminary in- 
vestigation, to examine differences in the 
test results as shown by a word count, 
refusals, description, and coherency, leav- 
ing the qualitative aspects of the pro- 
jected content for future investigation. 
Table 1 summarizes the word count ob- 
tained with the animal cards for each age 
group and Table 2 gives the same data 
for the TAT cards. The total word 
counts for each child for the animal cards 
and the TAT cards are found in Table. 3. 

The total word count elicited by the 
animal cards appears to be significantly 
greater than that obtained by the TAT 
cards. Statistical treatment of the data 
confirms this statement for a comparison 


Tanie 1. Total words told to the animal cards by age groups 


Card 


Age 1 2 3 4 5 7 9 10, Tetal 
430 305 317) 380) 4410 4200 759) 477) 07-4497 
855 738 1,081 871 703 1,078 756 1,041 804 809 8736 
856 926 946 B02 771) 772°) 878 890) 796) B62 BA99 
810 598 806 693 654 679 970 766 1,229 1,157 8362 
630 O31 O81 731 706 653 SOR 797 885 666 7,248 
1,075 1,007 1,288 1.350 1,260 1,182 1,168 1,459 1,450 1,178 12,417 

4.036 4.208 5,119 4,827 4,505 4,784 4.941 5,712 8.641 5,279 49,759 
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TABLE 2. 


Total words told to the TAT cards by age groups 


1 


10 Total 


345 
770 
770 
516 
710 
970 


549 550 280 
658 523 492 
812. 526 932 
594 406 614 
624 608 652 
919 787 1,098 


4,156 3,400 4,068 3,122 38,471. 


of the difference between the mean word 
counts obtained by the animal cards and 
the TAT cards and the standard error of 
this difference yields a critical ratio of 
6.82. 

It is also seen from Table 3 that in 35 
of the children the animal cards pro- 
duced a greater word count than did the 
TAT cards. 

It appeared to be easier for the children 
to formulate stories for the animal cards 
than for the TAT cards. One animal card 
was rejected as compared to 18 TAT 
cards rejected. Two of the children re- 
jected the entire test when presented with 
the TAT cards first; none of the chil- 
dren rejected the test when the animal 
cards were presented first. 

Qualitatively the stories told to the ani- 
mal cards appear to have more coherency 
than the TAT stories, but the meaningful- 
ness of the projected material can be de- 
termined only by additional study. Both 


sets of cards elicited material of a fairy 
tale nature but neither set produced a sut- 
ficient amount to seriously interfere with 
a content analysis. 

A further examination of Table 3. re- 
veals that if a criterion of 200 words is ac- 
cepted as the shortest average story that 
will have meaning for the clinician then 
both series of cards failed to elicit suffi- 
cient material.” Only three . children 
reached this criterion on the animal cards 
and two more approximated it, while 
on the TAT cards none of the children 
reached the criterion and only one child 
approximated it. 


DIscussION 


The data of this investigation show 
that the animal cards produced a greater 
quantity of material than did the TAT 


cards. With the group of subjects em- 
? 


2. Murray!) sets 140 words as the minimum 
but this seems too low for practical purposes. 


719 33 
1,210 || 34 
1,738 || 35 

655 ||. 

517 || 37 

908 

596 

807 

218 || 

692 || 

429 | 

335 

858 

863 |) 

539 || 
1,361 |) 


Total ... 49,759 
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405 511 298 459 381 311 4,089 } 
729 755 614 689 521 619 6,370 
736 578 712 689 854 541 7,150 
Na 547 538 481 755 486 358 5,295 
849 675 591 913 637 564 6,823 
Total ....... 4,081 4,188 3,847 3,498 4,479 3,632 
j 
a 
4 
| 
Taste 3. Total words told to the animal cards and TAT cards by each child 
Child Animal. TAT Child Animal TAT|| Child Animal TAT 
282 |/27 ........ 478 554 j 
1,901 |}28 ........ 610 1,766 
14 ........ 1,604 1,718 
sista S35 ........ 706 - 692 j 
| —— ——. 


ployed, though, neither series of cards 
elicited sufficient meaningful projected 
material to cause them to be useful diag- 
nostic instruments. The superiority of 
the animal cards was such as to strengthen 
the hypothesis that a series of cards could 
be designed which would serve as a valu- 
able diagnostic aid in the age group five to 
ten years. 
SUMMARY 


A series of ten cards depicting animals 
in various activities was designed to ob- 
tain projections of children’s personalities. 
The projections made to this series of 
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cards were compared with the projections 
obtained by the TAT cards. The subjects 
were 48 school children in the age range 5 
to 10 years. 

It appears, from a study of the amount 
of projected material, that the animal 
cards were superior to the TAT cards, but 
neither set of cards elicited sufficient ma- 
terial to meet a criterion of average story 
length set at 200 words, 
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A STUDY OF THE VALIDITY OF THE TAT AND A SET OF 
ANIMAL PICTURES’ 


ROBERT E. BILLS, CHARLES J. LEIMAN, AND RICHARD W. THOMAS 


INTRODUCTION 


In a recent article Bills“? reported a 
study comparing the quantity of projected 
material produced by children on the 
Thematic Apperception Test and a series 
of ten colored animal pictures. The ma- 
jor findings of this study were: (1) The 
quantity of material produced by the ani- 
mal pictures was significantly greater than 
that produced by the TAT. (2) It ap- 
peared to be easier for the children to 
formulate stories for the animal pictures 
than the TAT. (3) The amount of block- 
ing was less on the animal pictures than 
on the TAT. (4) The stories told to the 
animal pictures appeared to be more co- 
herent than those told to the TAT. 
(5) Neither the TAT nor the animal pic- 
tures elicited sufficient clinical material 
when used with children in the age group 
five to ten years. The following study 
was designed to compare the qualitative 
aspects of the projected material from the 
two tests. 

1. This study was made possible by an ap- 
propriation from the University of Kentucky 
Research Fund, for which the authors express 
their appreciation. 
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DESIGN 


Fight children selected from a_ third 
grade class were given six individual non- 
directive play therapy interviews. Each 
interview was electrically recorded and 
verbatim transcriptions were made from 
the recordings. Four girls and four boys 
were included in the group. 

In the week following the sixth play 
therapy contact each child was given the 
animal test and the first ten TAT cards, 
using cards appropriate to the sex of the 
child. The stories which the children told 
were recorded on wire and verbatim 
transcriptions were obtained from these 
recordings. The animal pictures were 
administered first for two of the boys and 
two of the girls and for the remaining 
four children the procedure was reversed. 


Data 


It was recognized that objective scor- 
ing systems which have been proposed for 
the TAT®: 345 have not proved very 
successful, since these systems have de- 
stroyed the dynamic qualities which have 
miade the test a valuable clinical instru- 
ment. For research purposes it is some- 
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times necessary to employ measures other 
than those which are more desirable clin- 
ically in an effort to obtain objectivity. 
Thus, it was decided to score the inter- 
view material, the animal stories, and the 
TAT by scoring twenty-six of the needs 
proposed by Murray‘? *?. 

In order further to objectify the scoring, 
only manifest needs were scored. The 
assumption was made that manifest needs 
represent an aspect of personality, and as 
such, should be similar regardless of 
where or how they were obtained. It was 
further assumed that the needs shown by 
a child in the final three nondirective 
therapy contacts should be an adequate 
criterion of the child’s manifest needs. 

The children who were the subjects of 
this study appeared to be making adequate 
life adjustments as evidenced by the teach- 
ers’ report, the Rorschach, and the Cali- 
fornia Test of Personality. The use of 
problem children as subjects would have 
introduced additional variables, since 


rapid changes in manifest needs from in- 
terview to interview might have occurred. 
Since the children were well adjusted, 


personality changes between interviews 
probably were at a minimum. 


Taste 1. Jntercorrelations of the need count 
obtained by the three scorers on one TAT 


The interview material, TAT, and ani- 
mal stories were scored independently by 
the three authors, each scoring one instru- 
ment. It was recognized that differences 
which might appear in the three instru- 
ments could be attributed to different 
scorers. ‘To control -this factor each of 
the authors scored a series of ten TAT 
stories for a child not included in the ex- 
perimental group. When the scores. of 
the three authors were correlated, the 
product moment correlation coefficients’ in 
Table 1 were obtained. All of these co- 
efficients are significant at less than the 
.O1 level of confidence, and there is no rea- 
son to assume that the scorers were in dis- 
agreement with each other. 

The manifest needs revealed by the 
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three instruments were correlated to give 
the coefficients contained in Table 2. Of 


Tasie 2. Intercorrelations of the needs of the 
eight children as revealed by the inter- 
view material 


Interview 
and 
animal 
pictures 


Animal 
Interview pictures 


Child and TAT and TAT 


* Significant at the .05 level of confidence. 
+ Significant at the .01 level of confidence. 


the twenty-four coefficients in Table 2, 
two are significant at the .05 level of con- 
fidence, and three are significant at the 
O1 level, and all but two are positive. 
For two of the children the animal stories 
and TAT correlated approximately the 
same with the interview material; for 
three of the children the animal pictures 
yielded higher coefficients ; and for the re- 
maining three children the TAT produced 
greater agreement with the interview ma- 
terial. The correlation coefficients for the 
animal pictures and TAT ranged from 
—.09 to .58. 

Discussion 


It appears that some agreement of 
manifest needs was present among the 
three instruments and that the animal 
stories and TAT reveal to a small de- 
gree the same needs. The differences 
which appear among the instruments are 
probably due to several factors: (1) Only 
manifest needs were scored. (2) Changes 
in manifest needs probably occurred from 
interview to interview as a result of 
therapy and therefore the validating crite- 
rion was not constant. (3) Each therapy 
or test situation represented a sample of 
a child’s behaviour, and differences are 
to be expected from sample to sample. 
(4) Interview material probably elicited 
a different proportion of some needs (for 
example: cognizance and achievement) 
than did the test material. (5) Certain 
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differences were probably due to the dif- 
ferent scorers. 


SUMMARY 


The TAT, animal stories, and interview 
material are in partial agreement and the 
study substantiates the claim that the ani- 
mal pictures and TAT are valid instru- 
ments for revealing manifest needs of chil- 
dren. 

No doubt other animal pictures can be 
created to surpass the present set. The 
cards now in use are described only as 
animals engaged in activity and the cards 
were not structured to investigate such 
variables as parent-child and sibling rela- 
tionships. The animal cards in their pres- 
ent form when used with children seem 
to be: (1) As valid and useful as the 


TAT. (2) An easier situation for formu- 
lating projective stories than is the TAT. 
(3) Capable of revision so that they will 
produce more meaningful results than the 
TAT. 
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AN ADOLESCENT PROBLEM REFLECTED IN THE TAT* 
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INTRODUCTION 


This paper is presented primarily for 
technical reasons and not as a case discus- 
sion. It permits us to demonstrate the 
value of the Thematic Apperception Test 
for studying small developmental changes 
in a personality. sixteen-and-a-half- 
year-old girl was seen in a social agency 
and given a TAT, a Bellevue Wechsler 
Intelligence Test, the Goodenough Draw- 
ing Test, and the Bender Gestalt Test. 
At that time, the girl was found to be an 
essentially normal adolescent with a com- 
pliant attitude toward a mother seen as 
benevolent, though somewhat domineer- 
ing. 

Eight months later the girl returned to 

* Paper tread at the annual meeting of the 
Eastern Psychological Association in April, 
1948 at Temple University, Philadelphia, Pa. 

+ At the time psychiatric consultant at the 
Jewish Board of Guardians, New York City, 

t Psychologist of the Jewish Board of Guardi- 
ans, New York City. 

§$ Social Worker, Jewish Board of Guardians, 
New York City. 


the social agency because of a minor emo- 
tional problem. At that time, a psychi- 
atric interview substantiated the impres- 
sions gained from the tests named above. 
However, as the girl had suffered quite 
a traumatic experience since the adminis- 
tration of the tests, a second TAT was 
administered by a different examiner, to 
ascertain any new dynamic developments. 
It was noted in the psychiatric interview 
that the girl now described the mother as 
somewhat more domineering—which de- 
scription may have had some basis in fact 
related to the mother’s entering into the 
menopause. 

The tirst and second TAT’s were com- 
pared ; they were then shown to two psy- 
chiatrists—independently — and to three 
classes on the TAT, conducted by the 
senior author. These classes were com- 
prised of one hundred and ten students, 
predominantly of the Ph.D. level and 
many practicing clinical psychologists. dn 
all cases, the two TAT records were 
shown for blind comparison: the judges 
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were told that these were TAT records 
of the same person, given at two different 
occasions. ‘They were not told which test 
was given when, nor what happened in 
between. The results were unanimous: 
the second record was identified as having 
been given later and was thought by the 
judges to have been administered after 
psychotherapy. They pointed out changes 
in the direction of maturation in the sec- 
ond record. 

It must be emphasized that the sub- 
ject had not received any psychotherapy 
and that the changes noted by the judges 
confirmed our personal impression of this 
girl's spontaneous emotional growth over 
a critical eight months period, as reflected 
in the difference in the two TAT records. 
The slight emotional disturbance for 
which the girl returned to the agency 
seems to have been incident to this de- 
velopmental process, and disappeared 
promptly. 

Below, we present four stories of each 
of the two TAT’s administered which we 
think are representative of the changes 
discussed, 

: First Record of TAT 

Boy with violin: See a boy at the fiddle; 

doesn't look very happy; seems to be sad. 

Don’t think he wants to play fiddle, though 

mother must want him to. I think mother 

wants him to for his education; wants him 
someday to be a violinist, but he doesn’t want 
to by looks of this. 

Second Record of TAT 

This is a boy looking at a violin. 

a sheet of music. He is thinking if he can 

play or not. I imagine he likes to play. He 

asked his mother for a violin and is thinking 
about it now. He played and became great. 

He looks very interested in it. 


There is 


In the first record we see the hero com- 
pliant to the mother, unwillingly, and un- 
happily. In the second record there is 
an independent striving, interest, the 
mother seen as giving. The tone is hap- 
pier, though self criticism has entered in. 
14. Silhouette at window: Picture of fellow 

looking at stars or moon; must be thinking 
of someone he loves, or perhaps his mother ; 
likes to be with her; seems lonesome; 
might be far away from home somewhere. 
That's all. 

This is a bov looking out of a window. It's 
dark out. He is looking at the stars and 
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sky. He is thinking of his future; of open- 
ing up a business—or what he’s going to 
do. He is thinking of his girl and home, 
and is peaceful. Maybe he got what he 
wanted, a happy life today, a happy home. 


The first record shows dependence on 
mother, longing and lonesomeness. The 
second record shows a very similar story, 
but the hero is peaceful, planning for the 
future, with independence and_hetero- 
sexual gratification (even though the hero 
is still a male). 
17GF. Girl on bridge: This picture looks as 
if by the river and men are working 
there. Girl leaning over bridge and she 
must be dreaming that someday her boy 
friend, off to war, and someday he would 
come home. That's about all. (What 
sort of girl is she?) Looks to be nice, 
sits home and waits, wouldn't go out 
with other fellows; she must love him 
very much. 


Girl on bridge: This is a river scene, 
down South. I'd say a girl is on a 
bridge. It’s a nice day and men are 
working. , She’s dreaming; looking out 
on water. Must have someone on seas 
—husband, or boy friend and she’s long- 
ing to have him near and see him again, 
to have him safe. He comes home and 
she sees him once more and _ they're 
happy. 


Again, the two stories are extremely 
similar. But in the first record it all stays 
on the fantasy level, and there is no 
resolution. In the second record a happy 
solution of the same problem is permitted 
on the reality level. 


20. Man by lamp post: Man by a light; seems 
to be waiting for someone; seems to be im- 
patient; seems to be waiting for fiancee and 


they can't see each other. Awaiting for an- 
other man. The reason he may not be able 
to see his fiancee, for mother forbids it. 
(Why?) She may not like him and so 
they have to meet on corners. (Why doesn’t 
the mother like him?) Bad disposition or 
different faith. (How does girl feel about 
this?) Girl likes him very much and doesn't 
care what the mother says but she doesn't 
want to hurt mother so sees him on the 
side. (What is the outcome?) In the end, 
she realizes that he is bad for her and lis- 
tens to her mothér. 


This is a man near a lamp post. 
waiting for his girl to come down. She is 
someone he loves. Her mother may not 
approve of him and they have to meet out- 
side. They love each other deeply. They 
meet on street corners. In the end her 


He is 


AN ADOLESCENT PROBLEM 


mother realizes that they love each other 
and grants their wish that they want to be 
married. Her mother disapproves of him 
because he might be of a different faith, 
might not have a job, or be of a different 
class than she. 


In the first record, mother is seen as a 
barrier to the hero's socio-sexual adjust- 
ment and the girl complies with her moth- 
er’s wishes, which she identifies with her 
own advantage. In the second record, 


the mother is still seen as disapproving 
but her approval is no longer essential for 
the hero who is more autonomous now, 
and by implication, more attached to the 
heterosexual object than to the mother. 
Here, the mother approves in the end, the 
subject thus achieving a synthesis. 


SUMMARY AND CONCLUSIONS 


Four stories to corresponding pictures 
of two TAT records were presented and 
compared, Both records were given to 
the same subject, sixtcen-and-a-half- 
year-old girl, administration of the two 
tests being eight months apart. 

In the stories of the first record, we 
see a girl still very much a child who sees 
the mother as demanding and _ limiting, 
and who complies with hesitation and un- 
happiness. In the second administration, 
the stories are extremely similar, except 
that the general tone is happier; there is 


297 


a striving for autonomy that is permitted 
to be successful. There is a development 
in the direction of heterosexual adjust- 
ment. Although the same problems are 
operative as in the first case, they can be 
resolved more satisfactorily and the sub- 
ject attempts self-realization and inde- 
pendence from the mother. While no 
huge upheaval has taken place, there 
seems to be real evidence of greater ma- 
turity, 

We believe that this case shows that the 
TAT is sensitive enough an instrument 
to reflect maturational processes in ado- 
lescence ; it could thus be used for much 
needed longitudinal studies of personality 
in the normal and the disturbed, under 
treatment. Furthermore, the TAT might 
serve as an index for guiding adolescents 
through their difficulties. It’s specific 
usefulness in demonstrating a subject's 
main conflicts, in interpersonal relation- _ 
ships, particularly with parental figures 
can be imleed invaluable for this 
purpose. 
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THE NATURE OF RORSCHACH RESPONSES 
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INTRODUCTION 


In the psychoanalytic and psychoso- 
matic literature dealing with pulmonary 


tuberculosis patients, considerable recog- - 


nition is given to the mental and emo- 
tional condition of the patient as a factor 
in the cure of his disease“ !©. Shultz), 
in a review of the psychological literature 
on the emotions of the tubercular, points 
out a relationship between emotional pat- 
terns and the course of the disease. Shultz 
found evidence indicating that correct 
mental attitudes actually aid the cure, 
while poor attitudes accelerate the prog- 
ress of the disease. However, very few 
experimental studies have, even remotely, 
tested the hypothesis concerning this re- 
lationship or narrowed the relationship to 
a point suitable for practical use in the 
clinical treatment of tubercular patients. 
This study purports to determine 
whether this relationship exists and at- 
tempts to establish some tentative Ror- 
schach test norms which may be used to 
supplement and to aid in the clinical prog- 
nosis of pulmonary tuberculosis patients. 


PROCEDURE 


The plan of this study was to compare 
statistically the totals of the Rorschach 
summaries of two groups of hospitalized, 
female pulmonary tuberculosis patients, 
13 in each of the groups. The two groups 
were statistically equal in age, intelligence, 
duration of illness, and time in the hos- 
pital. The critical difference between the 
two-groups was the course of the disease ; 
that is, progressive recovery or continued 
decline. This classification was made by 
the hospital staff of physicians independ- 
ently of the psychological testing, and it 
was determined that each patient was not 

* This study was reported at the December 
1949 meeting of the Texas Psychological Asso- 
ciation. 

+The writers are indebted to Bryce G. 
Hughett, M.D., now with the Colorado Psycho- 
pathic Hospital, for aid and cooperation in the 
collection of the data. 


consciously aware of her tubercular prog- 
nosis and the current course of her illness. 


RESULTS 


An inspection of the data for each group 
under 37 different Rorschach factoral pos- 
sibilities revealed 13 factors with distri- 
butions warranting valid statistical com- 
parison with the “t” test. Where it was 
statistically advisable, transformation of 
the raw data into percentage and angles 
was performed. The results are summar- 
ized in Table 1. 

All of the card rejections were obtained 
from the declining group. This included 
a total of 15 rejections from eight different 
patients. Card VIL (which is considered 
the female, identification card) was re- 
jected by five patients; Cards IV, V, V1, 
IX, and X were rejected twice each. 

The two groups were found to be statis- 
tically different in productivity and organ- 
izational activity beyond the 1 per cent 
level of confidence. The t-test of the dif- 
ference in their movement, range of con- 
tent, sum color responses, and popular re- 
sponse scores is significant at or beyond 
the 5 per cent confidence level. 


Disccssion AND CONCLUSIONS 


The results indicate that there is some 
psychological difference between pulmo- 
nary tuberculosis patients who are recover- 
ing and those who are declining. The 
mean productivity of the declining groups 
of 19.15 responses is not a healthy sign. 
The same is true of their low organiza- 
tional output (Z score), lower creative 
activity (M _ score), lessened emotional 
responsiveness (sum ©), reduced inter- 
ests (Content categories) and repressed 
conventionality of thinking (P score)“. 
However, these latter psychological dif- 
ferences may be as much a function of the 
reduced number of responses as a function 
of a true psychological difference. One 
other condition also limits the considera- 
tion of these differences as true psycholog- 
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TasB_e 1. Comparison of Rorschach test results for two groups of tubercular patients in 
declining and recovering states of the disease. 


Rorschach 
Factor 


Declining Group 


Mean SD. Range 


> Confi- 
Recovering Group 


Mean S.D. Range 


12-41 
5.0-34.8 
59.4-90.0 
0.0-29.2 
0-7 
0-5 


6.40 


66.7-100.0 || 


1-10 
6.7-53.7 
Sum Ct.* 3-14 
AG 25.0-77.3 


32.08 


10.19 
19.42 


0.336 

379 
3.261 
2.299 
1.243 
2.308 
0.945 


60.6-94.8 
9-54.5 
5-10 

12.0-42.8 
6-19 

31.7-56.7 


12.39 
1.69 


10.00 
44.5 


3.57 


“Number of different content categories. 


ical differences. This is the condition re- 
garding inflation of probabilities as dis- 
cussed by Cronbach? in his recent re- 
view of the statistical methods which 
have been applied to Rorschach scores. 
An increase in the possibility of chance 
differences arises when differences on 
many Rorschach scores are tested or when 
an inspection of the data leads to the rejec- 
tion of certain hypotheses. Even so, the 
psychological constriction which is indi- 
cated by the reduced productivity of the 
declining group (which was significant 
beyond the ‘1 per cent level) is enough to 
warrant the consideration of the hypo- 
thesis which is under investigation. 
Another real psychological difference 
is indicated by the card rejections. In 
Buhler’s?) Basic Rorschach Score, rejec- 
tion of cards is found to be characteristic 
of patients at the level of loss of reality. 
That is, the occurrence of this rejecting 
attitude is taken as a_ seriously patho- 
logic sign. Since all the card rejections 
were elicited from the declining group, 
there is a good indication that pathologic 
tendencies are more acute in declining pa- 
tients. It also indicates that future psy- 
chological investigation of tuberculosis 
patients should take into account the 
course of the patient’s disease. anes 
The following indices of Rorschach fac- 
tors are suggested for use in the prognosis 
of tuberculous patients, although only 
tentatively because of the size of the pres- 
ent samples, and the possibility of chance 


differences. The psychological factors 
not related to a process of recovery may 
be exposed on the Rorschach test by a re- 
sponse total and Z-score which are below 
the expectancy for a mentally healthy per- 
son; an experience balance which 
neither M nor Sum C is above a value of 
two; a range of content which is con- 
stricted to five categories or less; a popu- 
lar response total critically’ below the 
norm of seven ; and the rejection of one or 
more cards. ‘These Rorschach factoral 
constellations give a reliable indication 
that the mental health, as well as the 
physical health of the tuberculous patient 
needs attention during the treatment of 
the infection, 


SUMMARY 


1. The hypothesis that mental and 
emotional factors are related to the cure 
of tuberculosis is substantiated. 

2. Declining tuberculosis patients dif- 
fer from recovering patients by significant- 
ly lower productivity and creativity, less 
emotional contact with the environment, 
constricted interests and organizational 
activity, less conventionality of thinking, 
and rejection of stimulus material as these 
psychological processes are measured by 
the Rorschach test. 

3. The declining tuberculosis patient 
needs special psychiatric attention. 

4. Future psychological investigation 
of tuberculosis patients should take into 
account the course of the patient's disease. 
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Since the second paper on this statisti- 
cal quantity was published, several psy- 


chologists have asked the author to ra- 
tionalize a procedure which permits the 
use of all the segments, including seg- 
ments of zero slope. This note attempts 
to do just that. 

Formula 8 reads 


T= (K—1)—20, (1) 


where %0 is the number of sets in which 
one or both segments of a corresponding 
pair exhibit zero slope, K is the number 
of subtests, and K-1 is the number of sets 
of segments. 

There is reason to believe that the in- 
clusion of the quantity T as defined above 
in formulas 8-19{) would not yield exact- 
ly the binomial distribution. It appears 
that the distribution would be somewhat 
serrated. As N-x and K-~x, the 
binomial distribution might be said to be 
approached, As N and K decrease, there 
is increased divergence from the binomial 
distribution, For most practical purposes 
the use of the tables and procedures in 
reference 1 are adequate as they stand, 
since N and Kk are usually moderate in 
size. 


We now suggest the following proce- 
dures in order to (a) obtain the binomial 
distribution exactly, and (b) utilize sets 
in which zero slope segments occur in our 
computation Of Tps. 

Whenever zero slope segments occur 
in the reference or compared profiles it 
will be given either a positive or a nega- 
tive slope. The determination of the ap- 
propriate sign is made by reference to 
some chance operation where it is known 
that p=q. We suggest tossing a coin 
to determine the sign. The implicit as- 
sumption here is that when zero. slope 
segments occur, a very large sample of 
segments taken from the same individual 
or group would yield equal relative fre- 
quencies for positive and negative slopes 
and that if 1% of the zero slopes were 
given a positive sign and 14 given a nega- 
tive sign the resultant relative frequencies 
would be equal to each other and when 
summed, equal to 1. 

We now detine T as 

T=K~—1 (2) 
and this new value should be substituted 
directly into formulas 8-19), 

We now suggest the following steps in 
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the computation and test of significance 
of lps. 


Step 1. Plot the individual profile on the profile 
graph. 

Step 2. Select a reference profile and plot. 

Step 3. Inspect both profiles. If zero slope 
does not occur, omit this step and go directly 
to Step 4. If zero slope does occur, apply the 
following procedures : 

Select a coin: Let heads be positive and 
tails be negative. Toss the coin for each seg- 
ment where zero slope occurs and write in the 
appropriate sign for each segment. For ex- 
ample: If reference profile X has two zero 
slopes and individual profile Y has three zero 
slopes, the coin is tossed five times. Caution: 
the coin is tossed for the occurrence of zero 
slope in the reference profile every time a dif- 
ferent individual profile is compared. 

Step 4. Place a check mark (\/) where a pair 
of segments exhibit similar slopes and a cross 
mark (&) where a pair of segments exhibit 
dissimilar slopes. 

Step 5. Count the check marks (\/); this is S. 
The quantity T is the number of subtests 


minus | and remains constant for any particu- 
lar test or test battery. A simple check is to 
compute: T=2 (VY) +2 (xX). 


Step 6. Compute rpg as 


Tpg = 2(S/T—.50) (3) 
Compute as 
. (4) 


Test the null hypothesis. 
When Tables 1 and 2 (1) are available, the 
computations in Step 6 are not necessary. 


SUMMARY 


This note on the coefficient of profile 
similarity rationalizes a procedure which 
permits the use of all segments, including 
segments of zero slope. 
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THE USE OF 


CLINICAL 


The experimentalist traditionally eval- 
uates the reliability of his statistical find- 
ings by attaching a standard error or 
probable error to each statistic, and 
thinks in terms of “absolute” reliability, 
The clinician traditionally examines the 
reliability coefficient of a new test and 
thinks in terms of “relative” reliability in 
subsequent usage of the test. In too many 
instances, probably, the latter practice 
leads to lessened precision in interpreting 
the test results of a given individual in 
the practical clinical situation. In too 
many instances, too, in the everyday use 
of a test, the problem of reliability is prob- 
ably implicitly dismissed after initial in- 
spection of the coefficient satisties the 
clinician that the test is “reliable.” 

To emphasize the reality of the problem 
of the reliability of test scores, students in 
the clinical practicum at the Psychological 
Clinic of the University of Cincinnati are 
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RELIABILITY DATA IN 


WEAVER 


trained to attach routinely to a test score 
its standard error, oo. In addition, in 
the psychographic plotting of the test 
scores of a case, they are trained to repre- 
sent by light lines the fiducial band ex- 
tending one and in some cases two stand- 
ard errors on either side of the plotted 
points. 

This procedure is admittedly more 
trouble than the traditional practice. The 
following advantages, however, justify 
the additional effort: 


1. Reliability information is given di- 
rectly in terms of units on the meas- 
urement scale and hence is more im- 
mediately useful in the interpretive 
process than an abstract reliability 
coefficient. Students report that the 
numerical and graphical representa- 
tion of the reliability of each test 
score is much more meaningful than a 
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3. 


4. 


vaguely remembered correlation co- 
efficient noted in the test manual. 
Variation reliability when such 
exists at different positions on the 
measurement scale, as on the Revised 
Stanford-Binet, is explicitly given by 
the varying values of the standard er- 
ror of measurement. Dependence on 
reliability coefficients alone is less like- 
ly to bring this circumstance into the 
interpretive process in a precise man- 
ner. 

The reliability information given by 
the standard error of measurement is 
comparatively unaffected by the range 
of ability in the standardization group. 
As Kelley: 2) pointed out, if a test 
he assumed to be equally effective in 
all ranges of ability, the reliability co- 
efficient varies with the range. Thus, 


a test which yields a_ reliability co- 
efficient ry, of 0.40 when standardized 
on a group having a standard devia- 
tion of 10, will yield a coefficient ry, 
of 0.9332 when applied to a group 
standard deviation of 30, 


having a 
since 
Or 1 th 


Ty 
ard error of 
stable at 7.75, 

Precise evaluation of the significance 

of the difference of an individual’s test 

score from a critical score point or 
from a reference point on the meas- 
urement scale (e.g., 1Q of 100) may 
be readily obtained by a simple com- 
putation. ‘There is also less likelihood 
of an error of interpretation such as 
the judgment that an IQ of 69 is sig- 

nificantly below a critical value of 70. 

recise evaluation of the significance 

of the difference between the scores of 


\ : but the stand- 


measurement remains 
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two individuals on a test or between 
test and retest scores of the same in- 
dividual is readily given by appro- 
priate computations. 

The reality of the reliability problem 
in selecting tests for clinical usage is 
made more vivid, and students are 
stimulated to more critical scrutiny of 
the relative accuracy of tests before 
selecting one for administration to a 
case, 

The procedure brings the treatment 
of the reliability problem in clinical 
practice into line with that of the ex- 
perimentalist psychology and = in 
other scientific fields. 


Considerable difficulty was experienced 
in determining the standard errors ap- 
propriate to particular tests. In a few 
cases the standard error of measuremerit 
is explicitly stated, in others it is possible 
to compute it from data given in the test 
manual. In many cases, however, the 
standardization data reported by the au- 
thor are so meager that the standard er- 
ror can be computed only tentatively or 
not at all. It is regrettable that full in- 
formation on absolute reliability is not re- 
ported routinely by test authors in view 
of the clear advantages such data would 
provide in the practical clinical situation. 
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EDITORIAL OPINION 


This issue contains the first of a series 
of annual reports concerning the status of 
research in the field of clinical psychology. 
It is planned that these annual reviews 
will contain not only an objective state- 
ment of the quantitative incidence of re- 
search in all of the areas of clinical psy- 
chology but also an estimate of the quali- 
tative importance of developing trends. 
Three conclusions of importance may be 
derived from this first annual survey of 
the research literature. First, it is now 
evident that the era of uncritical enthu- 
siasm for projective methods has now 
come to an end as research reports fail 
to demonstrate the validity of many un- 
derlying variables. This finding could 
have been predicted by recognition of 
the ,simple fact that the validity of the 
underlying Freudian theory upon which 
many dynamic interpretations have been 
based is itself questionable. It does not 
seem unfair to suggest that the theory 
underlying many projective interpretive 
concepts is like a house of cards which 
may be demolished at any time if many 
of its basic concepts are proven invalid. 
This is not to deny the value of projec- 
tive tests, but simply to insist that their 
use must be surrounded by the most exact- 
ing scientific controls of which there are 
now only too few. The second major de- 
velopment has been the general collapse of 
attempts to differentiate diagnostic cate- 
gories either on the basis of patterns of 
symptoms (as in the MMPI) or on the 
basis of Wechsler-Bellevue subtest pat- 
terns or deterioration indexes. Here again, 
this result could have been predicted from 
recognition of the invalidity of underly- 
ing concepts and_ statistical procedures. 
Although Kraepelinian diagnostic con- 
cepts have largely been abandoned in our 
dynamic clinical thinking, we continue to 
base research on an outdated and totally 
unsatisfactory diagnostic — classification 
system. If many of the underlying diag- 
nostic classifications are meaningless, 
what can be presumed for the validity of 
research reports utilizing them? The third 
development has been the appearance of 


increasing skepticism concerning — the 
value of process analysis, as with non- 
directive methods, of therapeutic proced- 
ures until the basic frame of reference has 
been carefully delineated in terms of ac- 
curate diagnostic and psychopathological 
studies. Of what value is a map unless 
the location of its various coordinates is 
known? To speak of therapeutic effects 
without first having objectively established 
the fact and nature of disorder is to be 
utterly illogical and unscientific. 

The current state of research progress 
in the clinical psychological sciences indi- 
cates that we are at a crossroads at 
which considerable thinking needs to be 
done. Clinical psychology is a belated 
arrival in the clinical field as compared 
with psychiatry and psychoanalysis. Be- 
cause of its late arrival, it has fallen heir 
toa large number of theories and empirical 
findings which it had, perforce, to accept 
more or less on faith. The Kraepelinian 
diagnostic system is one example of our 
inheritance, and the Freudian metapsy- 
chology is another. In the absence of more 
objective data, clinical psychology has had 
to make at least a beginning on research 
in terms of these concepts borrowed from 
psychiatry and psychoanalysis. The time 
has come to recognize that many of the 
existing psychiatric and psychoanalytic 
concepts are invalid, and that we must 
begin at the beginning to create a new 
science. F.ven though such thoughts may 
disturb our psychiatric and psychoanalytic 
colleagues, we must accept nothing as 
being valid until it has been demonstrated 
to be so. 

Fortunately, the research methods exist 
for resolving much of the confusion. Ex- 
perimental psychology has succeeded in 
laying the foundations of basic science 
upon which more valid theories and hy- 
potheses can be constructed. If clinical 
psychologists are to be scientists, they 
must adhere rigidly to its principles even 
at the cost of temporary lesser expansion 
of the field. It is disturbing to discover 


the facility with which some leading fig- 


ures in the field are able to doff the coat 
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of scientific objectivism and to don a coat 
of many colors in their too ready accept- 
ance of many of the current psychiatric 
and psychoanalytic fads. When the scien- 
tific day of judgment arrives, many of 
our leading figures are going to be found 
wanting because of their too ready obei- 
sance to the ruling fads or “schools.” 
F.C.T, 

Your editor continues to receive letters 
expressing dissatisfaction criticism 
relating to existing standards for the rec- 
ognition and certification of personnel 
with qualifications less than those required 
by the AMERICAN PsyCHOLOGICAL Asso- 
CIATION and the AMERICAN BoArp OF 
EXAMINERS IN PROFESSIONAL PsyCHOL- 
ocy. Once again it seems important to 
review some of the questions at issue. 
The fact is that large numbers of persons 
continue to receive basic training in clin- 
ical psychology outside the established pro- 
gram leading to the doctorate. Many 
undergraduate departments. are continu- 
ing to offer comprehensive courses in ab- 
normal psychology, psychometrics and 
elementary counseling and psychotherapy. 
Practically all of the teacher training in- 
stitutions offer courses in psychometrics, 
counseling and guidance. Most of the 
recognized graduate departments also of- 
fer courses in psychometrics, counseling 
and guidance on the level of the master’s 
degree, and it may be estimated that the 
total number of persons receiving this 
lower level training far exceeds those who 
achieve the doctorate. Commercialism in 
graduate education has reached the point 
where by shopping around in extension 
courses and summer session offerings, it is 
literally possible for any one with a bach- 
elor’s degree to enroll for any or all of 
the technical courses which are ordinarily 
considered to lead up to the doctorate. 
This paradoxical situation has resulted 
in the establishment of two patterns of 
training. The standard pattern is to be 
accepted as a doctoral candidate at one of 
the recognized departments and to finally 
secure the degree. The alternate route 


is to take all of the same courses without 
being accepted as a doctoral candidate, 
and thus to acquire almost the same train- 
ing (except for the requirement of the 
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thesis based on research). Thus, the sit- 
uation has developed where there are 
probably as many persons doing psy- 
chological work outside of recognized 
auspices of training and professional stand- 
ing as there are within it. 

This situation is a function of the cur- 
rent confused state of affairs concerning 
the offering of graduate education on less 
than doctoral levels to all comers, rather 
than of any ulterior motivation on the 
part of those who do not have the doc- 
torate. As long as such training continues 
to be provided outside of recognized doc- 
toral training programs, it will be inevita- 
ble that hundreds or thousands of persons 
will avail themselves of such opportuni- 
ties. The justification for securing train- 
ing on less than doctoral levels is derived 
from the fact that a large number of well 
paying positions are currently available 
for personnel possessing only minimum 
requirements, Both in private and gov- 
ernmental agencies there are probably 
more jobs available requiring less than 
doctoral training than there are jobs which 
do. As long as the demand for person- 
nel far exceeds the supply of Ph.D.’s, it 
may be expected that large numbers of 
people with lesser training will enter the 
field. There would appear to be only 
two solutions to this situation. Either 
facilities should be developed to provide 
Ph.D.’s tor all available positions in clin- 
ical psychology, or some recognition should 
be granted on lower levels for those of 
lesser training. If the former solution 
is accepted, then extensive course offer- 
ings in clinical psychology outside the es- 
tablished doctoral training program should 
be prohibited nationally. If training con- 
tinues to be provided to all comers, then 
some system of regulation needs to be 
established quickly, 

Unless ABEPP takes on the functions 
‘of certifying professional personnel at 
lower levels, it is inevitable that there 
will be created some other certifying 
agency to fulfill this function. The sit- 
uation is analogous to the certification of 
various types of medical technicians such 
as physiotherapists, N-Ray technicians, 
laboratory technicians, etc. The APA may 
expect a schism within its ranks, with 
either the separation of a dissatistied 


minority or the organization of new spe- 
cialty societies, unless something is quickly 
accomplished to satisfy the needs of lower 
level personnel. While recognizing the 
values of the highest professional stan- 
dards, the practical needs of the current 
situation cannot be overlooked. The 
ABEPP will need to examine its own 
conscience in behaving expediently in the 
matter of providing some form of recog- 
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nition for those who deserve it according 
to the average standards of timé and place. 
We are not interested in breeding a race 
of psychological Super Men, but simply 
in protecting the current status of the pro- 
fession. While the ABEPP appears to 
be fulfilling its functions admirably well 
on the whole, there has been some dis- 
satisfaction with its overconscientiousness 
in the direction of perfectionism. F.c.7. 
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SALTER, ANbDREW, Conditioned Reflex 
Therapy. New York: Creative Age 
Press, 1949, pp. 359, $3.75. 

Every so often there appears a book 
which involves a clear prostitution of ex- 
perimental science by the use of catchy 
titles and pseudo-scientific applications of 
basic scientific data which are valid 
enough when taken in the proper contexts. 
This is one of those books which appear 
to be written for popular consumption 
and the author’s financial improvement, 
and which represents an unhappy com- 
bination of scientific sophistication and 
pure charlatanism, The basic concept of 
seeking to construct a system of therapy 
based on the psychology of learning and 
conditioning 1s a very admirable one. But 
unfortunately, Dr: Salter has only one 
string on his violin, and that is that all 
human troubles are caused by excessive 
inhibition, or a “fundamental deprivation 
of excitation,” for which the answer is 
for the patient to “disinhibit” himself, to 
return to a state of constant spontaneous 
excitation. Dr. Salter gives some pretty 
strong advice when he requires all patients 
to “contradict and attack,” to deliberately 
use the word ‘I’ as much as possible, to 
practice constant . self-praise, % 10) 
The theme song is “If you want to do 
something, go ahead and do it. Don't 
inhibit yourself.” Dr. Salter evidently 
believes in this himself because he gives 
detailed and commendatory accounts of 
his use of these techniques in problems of 
addiction, anxiety, psychosomatic disor- 
ders, masochism, homosexuality and other 


sex disorders, and with psychopathic per- 
sonalities. We shudder to think of the 
effect of all this on the neurotic layman 
who will be attracted to this book because 
of the advertising which has been given it. 
Our psychiatric colleagues will wonder 
what kind of a psychologist it is who 
writes that “Inhibition is living death” 
‘» 4 that “There is no greater obscenity 
than an inhibitory psychiatrist” (5°, or 
that the inhibitory “are veritable Medusas, 
with wriggling cortical angleworms” 24). 
Professional psychology should be quick 
to repudiate efforts such as this. 


Coun, Rosert. Clinical Electroencephal- 
ography. New York: McGraw-Hill, 
1949, $14.00. 

Dr. Cohn is electroencephalographer and 
Director of Neurological Research at the 
U. S. Naval Hospital, Bethesda, Mary- 
land. ~The technical discussions are ex- 
ceptionally clear and illustrated with 273 
LLG tracings. This is the most complete 


‘atlas of EEG which we have seen, 


Wittiamson, and Forry, J. D. 
Counseling and Discipline. New York: 
McGraw-Hill, 1949. pp. 387. $3.75. 
Dr. Williamson is Dean of Students and 

Professor of Psychology at the University 

of Minnesota and well known for his con- 

tributions to the field of counseling under 
educational auspices. This book relates 
specifically to the administrative handling 
of disciplinary problems with a clear ex- 
position of the system used at the Uni- 
versity of Minnesota. 
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O’Ketty, L. I. Introduction to Psycho- 
pathology. New York: Prentice-Hall, 
1949, pp. 736. $4.50. 

The author is Professor of Psychology 
at the University of Ilinois. The book 
summarizes the fields of abnormal psy- 
chology, psychiatry, elementary psycho- 
analysis and social psychopathology. The 
presentation is on an intermediate level, 
too difficult for the undergraduate, and 
too elementary for the medically trained 
specialist. 


Mater, N.R.F. Frustration. New York: 
McGraw-Hill, 1949, pp. 264. $3.50. 


This book summarizes the experimental 
studies of frustration carried on by the 
author. The first two-thirds of the book 
discusses the research results, while the 
last third consists of somewhat tenuous 
theoretical discussions of the implications 
and applications of frustration theory. 


Harsu, Cuartes M. and ScuricKeL, 
H. G. Personality: Development and 
Assessment. New York: Ronald Press, 
1950, pp. 518. $5.% 

The authors are yale, of the psy- 
chology department «° the University of 
Nebraska. This is a scientifically oriented 
textbook suited to undergraduate students. 
The orientation is primarily that of ap- 
plied psychology. 


Zipr, GeorGE K. Human Behavior and 
the Principle of Least Effort. Cam- 
bridge, (Mass.): Addison - Wesley, 
1949, pp. 573. 

This is a report of many years of re- 
search and collection of data in an attempt 
to demonstrate that all behavior may be 
understood in terms of a primary Principle 
of Least Effort. Data are presented from 
all fields of human endeavor in support 
of this principle. 


Watkins, Joun G. Hypnotherapy of 
Har Neuroses. New York: Ronald 
Press, 1949, pp. 384. $5.00. 

Dr. Watkins was formerly Chief Clin- 
ical Psychologist at Welch Convalescent 
Hospital and is presently associate pro- 
fessor of psychology at the State College 
of Washington. This book outlines the 
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use of hypnotherapy in a military con- 
valescent hospital. The details of inducing 
the trance and of advanced hypnothera- 
peutic technique are clearly presented. 
Various types of illustrative cases are 

described in detail. q 


Trepcotp, R.. F. Human Relations in 
Modern Industry. New York: Inter- 
national Universities Press, 1949, pp. 
192. $2.50. 


An English psychiatrist writes on psy- 
chological problems of industry. 


Symonps, PercivaL M. The Dynamics 
of Parent-Child Relationships. New 
York: Teachers College Bureau of 
Publications, 1949, pp. 220. $3.50. 
Dr. Symonds is professor of education 

at Teachers College and well known for 
his studies of the dynamics of parent-child 
relations. This is an elementary discussion 
of such relations for counselors and guid- 
ance workers. 


SONNEMANN, ULRICH. Handwriting 
Analysis. New York: Grune & Strat- 
ton, 1950, pp. 276. $5.00. 

Dr. Sonnemann is associate professor 
at the New School for Social Research, 
and lecturer on the graduate faculty at 
City College of New York. This is an 
empiric study of the traits which clinical 
experience has shown to be associated 
with the physical characteristics of hand- 
writing. A system is outlined for the 
analysis of the different attributes of hand- 
writing. 


Kupie, Lawrence Practical and 
Theoretical Aspects of Psychoanalysis. 
New York: International Universities 
Press, 1950, pp. 252, $4.00. 

Dr. Kubie is clinical professor of psy- 
chiatry and mental hygiene at the Yale 
University School of Medicine, and a 
well known practicing analyst. This book 
is intended to answer the questions of the 
layman concerning the practical details 
of what psychoanalysis is. Thus the pro- 
spective patient can read up for himself 
beforehand concerning what to expect in 
analysis. One wonders why so many books 
of this type have been recently published. 
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Is it because psychoanalysis needs to ad- 
vertise itself and gain more patients ? 


Weiss, Epoarpo, Principles of Psycho- 
dynamics. New York: Grune & Strat- 
ton, 1950, pp. 268. $4.00. 

Dr. Weiss is a practicing analyst asso- 
ciated with the Chicago Institute for Psy- 
choanalysis. The book consists of theo- 
retical essays elaborating on Paul Federn’s 
“Ego Psychology” and concerning the 
various forms of identification on which 
different kinds of interpersonal relations 
are based. There is little attempt to relate 
the discussions to the basic science data 
of experimental psychology. 


Hess, D. O. Organization of Behavior. 
New York: Wiley, 1949, pp. 335, 
$4.00. 

Dr. Hebb is professor of psychology 
at McGill University. He has written a 
very scholarly book integrating the latest 
data in neurophysiology and psychology. 
This will make a good reference book for 
courses in elementary general and exper- 
imental psychology. 


NUNBERG, HERMAN. Problems of Bisex- 
uality as Reflected in Circumcision. 
London: Imago Publishing Co., 1949, 
pp. 83. Price 10/-. 

This essay was originally published in 
the /nternational Journal of Psychoanaly- 


sis, 1947, Vol. XXVIII. 


Securn, C. Introduction to 
Psychosomatic Medicine. New York: 
International Universities Press, 1950, 
pp. 320. $5.00. 


Dr. Seguin is professor of psychoso- 
matic medicine at the University of San 
Marco, Lima, Peru. This is a rather ele- 
mentary but very well thought out intro- 
duction to psychosomatic problems. There 
is no index and the orientation, although 
scientific, is not well documented. 


Meertoo, Joost, A. M. Patterns of 
Panic, New York: International Uni- 
versities Press, 1950, pp. 120. $2.00. 
Formerly a well known Dutch psyechia- 

trist, Dr. Meerloo is now a practicing psy- 
choanalyst in New York. This little 
hook consists of five essays on the general 
nature of group panic. The material ts 
anecdotal in nature, 


Boss, M. Meaning and Content of Sexual 
Perversions. New York: Grune & 
Stratton, 1949, pp. 153. $3.50. 

Dr. Boss is a Swiss training analyst and 
lecturer on psychotherapy. One of the 
recent trends in European psychiatry is a 
combination of the viewpoints of phenom- 
enology and psychoanalysis as the 
Daseinsanalyse of Martin Heidegger. An 
empiric study of deviant sex behavior 
with particular emphasis on the subjective 
experiences of the patients. 
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Keady for Fall Classes 


PRINCIPLES OF PERSONALITY | 
COUNSELING 
BY 
FREDERICK C. THORNE, M.D., Pu.D. 


University of Vermont 


Tuis New Textrsook or Personatiry COUNSELING PRESENTS THE 
First GENUINELY System oF PERSONALITY COUNSELING 
IncLupING Descriptions AND EXAMPLES OF ALL THE KNowN METH- 
ops OF PSYCHOTHERAPY SUITABLE FOR PERSONALITY COUNSELING. 


THIRTY-TWO CHAPTERS— 

Five Chapters on THe Scirentiric Basis ror Personatiry CouNsELING 

Five Chapters on THe Basic Conprrions or Personatrry CouNSELING 

Four Chapters on Metruops ror Deatinc with PresentinG 

Five Chapters on Deatinc wrrn Emorionat Facrors MALapJUSTMENT 

Four Chapters on Mernops ov INFLUENCING THE CLIENT For THERAPEUTIC PUrR- 
POSES 

Five Chapters on Mernops ror Maximizinc Resources 

Four Chapters on Meruops or INTELLECTUAL REORIENTATION 


PRICE: $5.00 


Sorry, no examination copies 


Ten percent discount on 5 to 10 copies, twenty percent discount 
on larger orders 


ORDER FROM 


Journal of Clinical Psychology 
5 PEARL STREET 
BRANDON, VERMONT 
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ANNOUNCEMENT 


Champlain Workshops 


In our preliminary announcements, we made the mistake of an- 
nouncing too many alternative dates. The result has been some diffi- 
culty in getting people together on a suitable date. 


Sorry also that we did not make clear that these were to be post- 
graduate Workshops limited only to professional Clinical Psycholo- 
gists. It will not be possible to accept graduate students. 


As a result of special requests, it has been decided to restrict the 
topics of the two Workshops. 


I. Diacnostic PropLeMs IN PeRsoNALity CouNSELING. This Workshop will consider 
the question of revising the standard diagnostic classifications with reference to the 
specific problems of personality counseling. 


II. Ecrecric Counsetinc MetHops. This Workshop will deal with the systematic ap- 


plication of all known scientific methods of psychotherapy suitable for counseling. 
A number of new techniques will be discussed in detail. 


GENERAL INFORMATION 


PLACE. The Workshops will be held at Grand Isle, Vermont. Grand Isle is an historic island 
thirteen miles long lying in the middle of the northern end of Lake Champlain. This unspoiled 
country is among the prettiest in New England with spectacular views and provisions for all 
summer sports. It may be reached via the Rutland Railroad from New York or by U. S. Route 2. 


SCHEDULE. The Workshops will be confined to morning hours from 8:30 A.M. to 12:30 P.M. 
from Monday through Saturday. There will be approximately 25 hours of intensive work and 
discussion in each Workshop. ‘The afternoons will be left free for rest or recreation. 


DATES. Final dates will depend upon convenience of registrants. Tentative dates are: Course I, 
July 17-22 or August 21-26. Course I, July 24-29 or August 28-September 2. Please indicate 
preference when registering. 


REGISTRATION. Will be limited to professional psychologists and students beyond the level of 
the Master’s degree. It is expected that each registrant will have had sufficient clinical experi- 
ence to be able to contribute to the Workshop. Only a limited number will be accepted at each 
Workshop. 


FEES. A fee of $25.00 will be charged for each Workshop, payable in odvence: This payment will 


insure a reservation. Registrants should apply early. 


ACCOMMODATIONS. Several high quality hotels, boarding houses and tourist camps are adjacent 
to the site of the Workshop. Room and board may be obtained at from $5.00 per day up. The 
Workshop will assume responsibility for locating accommodations for everyone. Please indicate 
type desired. 


Send applications to: 
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BRANDON, VERMONT 
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PROVIDES PHYSICIANS WITH FACILITIES FOR 


The Education and Treatment 
of Children 

With Academic or Emotional 

Difficulties 


Applications for fall en- 
trance now being re- 
ceived. A representative 
of Devereux may soon be 
in your vicinity and would 
be glad to confer with you 
or with any parent you 
recommend. Write the 
Registrar. 


Twelve separate home-school units in 
Pennsylvania and the Devereux Ranch 
School in California offer a controlled en- 
vironment and modern training shaped to 
the needs of each child. 


Devereux is unique in that it combines 
complete school facilities for children of 
kindergarten through high school age with 
complete medical, psychiatric, and psycho- 


Rutu E. Durry, M.D. 
Rospert Devereux, M.D. 


Rosert G. Fercuson, A.M., Educational Psychologist 


logical services. 


The professional staff cooperates with the 
referring physician in his plans for the 
child’s training and care. 


HELEN T. DEVEREUX, Director 


Resident Medical Staff 


Lesuiz R. ANcus, M.D. 
ALEXANDER Aarons, M.D. 


Micuaet B. DuNN, A.M., Clinical Psychologist 
Epcar A. Do.t, Pu.D., Coérdinator of Research 


For Information, address the Registrar 


JOHN M. BARCLAY, Devon, Pennsylvania 


Under the Devereux Foundation, an organization not for profit 


| sent Barbara, California 


Devon, Pennsylvania 


